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SECTION  I 


INTRODUCTION  AND  SUMMARY 


This  draft  Final  Technic.il  Report  is  a comprehensive  pre- 
sentation of  AAl's  study  results  from  contract  number  DSA  906-75-5161. 
This  effort  has  been  directed  towards  the  development  of  measures  for 
quantifying  the  Defense  Documentation  Center's  (DDC)  operational  goals 

1.1  PURPOSE  AND  BACKGROUND  OF  THE  CONTRACTUAL  EFFORT 

This  study  builds  upon  the  work  of  the  DDC  10  Year  Require- 
ments and  Planning  Study  completed  in  June  1976. ^ With  that  final 
report  DDC  was  provided  with  a set  of  recommendations  for  projects 
that  would  serve  its  users'  information  requirements  and  which  were 
technologically  feasible  in  the  planning  period  1978  to  1988.  The 
task  remaining  for  DDC  is  to  prepare  budget  programs  over  the  next 
decade  to  deal  with  the  long  range  requirements  while  at  the  same  time 
meeting  the  administrative  requirements  of  its  top  management. 


^For  the  detailed  discussion  of  the  prior  study,  see  AUERBACH  Asr.ociat 
Inc.  DDC  10  Year  Requirements  and  Planning  Study:  Final  Report,  June 
13,  1976.  2 Volumes.  (AUER  2325/2 326-TR-5 ; AD-A024  700,  AD-024  701). 


The  usual  technique  for  establishing  an  operating  DDC  budget 
follows  the  Program/Budget  approval  cycle  of  the  Department  of  Defense. 
Program/Budgets  are  prepared  at  the  operating  level  and  with  limited 
resources  available  to  funding  administrators  a negotiation  process 
is  used  to  arrive  at  an  operating  Program/Budget. 

This  is  an  artful  management  process  which  has  proven  to  be 
workable.  The  system,  however,  does  not  automatically  provide  solutions 
to  dilemmas  which  develop  in  the  negotiation  process. 

The  tools  of  management  science  use  data  such  as  systems  bene- 
fit projections,  costs  and  user  studies  that  go  far  in  helping  to  make 
some  of  the  difficult  decisions  in  a rational  manner.  Indeed,  such  data 
are  an  important  aspect  of  the  current  DDC  Program/Budget.  But  data 
alone  does  not  resolve  decisions.  Decision  analysis  techniques,  usually 
based  on  a model  of  the  decision  environment,  do  provide  a tool  to 
answer  questions  about  alternative  program  strategies  and  the  value  of 
various  adjustments  in  resource  allocations  among  projects.  The  use 
of  models  helps  maintain  a consistent  basis  for  decision  making  from 
the  operating  level  up  through  the  administrative  approval  cycle. 

The  question  which  arose  from  the  basic  planning  and  require- 
ment study  is  whether  a more  rigorous  planning  technique  from  the  field 
of  management  science  can  help  clarify  the  decision  analysis  process 
with  regard  to  DDC's  long  range  planning  program.  Specifically,  can 
such  a management  tool  help  the  DDC  Administrator  and  his  Program/ 

Budget  planners  allocate  resources  and  select  programs  that  meet  with 
the  satisfaction  of  DDC's  top  management? 

1 . 2 SUBJECT  OF  THE  CONTRACTUAL  EFFORT 

Of  the  techniques  available,  mathematical  modeling  was 
identified  as  the  most  appropriate  technique  for  the  DDC  environment. 
Furthermore,  it  is  crucial  that  in  order  for  the  model  to  be  practical, 
the  decision  analysis  technique  selected  had  to  be  capable  of  reflecting 
administrative  judgement  about  the  priority  of  desired  goals  and  be 
able  to  deal  with  conflicting  goals  among  several  independent  adminis- 
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trative  constituencies  served  by  DDC.  The  goal  programming  approach 
2 

described  by  Lee  appeared  to  be  the  most  practical  technique  for 
developing  a model  of  a decision-making  environment  with  multiple, 
competitive  and  conflicting  goals  and  varying  priorities. 

Goal  programming  is  a special  extension  of  linear  programming 
that  has  been  developed  for  solving  decision  problems  in  which  manage- 
ment sets  goals  which  are  achieved  only  at  the  expense  of  each  other. 

1.3  STUDY  OBJECTIVE 

It  is  the  objective  of  this  study  to  present  a pragmatic 
goal  programming  model  applicable  to  DDC's  decision  environment  and 
test  its  application  potential  for  resource  allocation  and  project 
evaluation.  The  scope  of  the  study  is  limited  in  that  it  does  not 
attempt  to  include  the  full  complexity  of  the  DDC  operation.  Rather, 
the  prime  interest  has  been  in  developing  a clear  presentation  of  the 
goal  programming  methodology  in  the  DDC  environment. 

1.4  SUMMARY  OF  THE  STUDY  METHOD 


The  study  objective  has  been  achieved  in  four  steps: 

1.  First  it  was  necessary  to  define  a goal  oriented  program 
structure  from  an  administrative  point  of  view.  This 
has  been  done  through  face-to-face  interviews  with  top 
level  administrators  in  the  Department  of  Defense  who 
were  selected  with  DDC  guidance  to  represent  the 
administrative  elements  that  DDC's  program  is  intended  to 
serve.  The  interview  findings  are  shown  in  Appendix  A. 
The  interviews  provided  the  basis  for  DDC's  organizational 
goals  as  used  in  the  goal  programming  model. 


2 

Sang  Lee,  Goal  Programming  for  Decision  Analysis,  AUERBACH  Publishers, 
Inc.  Philadelphia,  Pa.  1972. 
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Second,  an  extensive  literature  search  has  been  made  to 
identify  practical  measures  of  information  service  use- 
ful for  program  evaluation.  These  results  are  provided 
in  Section  II. 

3.  The  third  step  was  to  construct  a goal  programming  model 
following  the  procedures  outlined  by  Lee  : 

- define  measureable  input  and  output  program  elements 
for  current  and  potential  projects 

- Set  target  performance  /criteria  with  DDC  management 
participation 

- define  operating  relationships  among  current  and 
potential  projects 

The  details  of  this  task  are  shown  in  Section  III. 

4.  Finally,  the  practical  application  potential  of  the  tech- 
nique has  been  examined  in  a simulated  decision-making 
process  using  DDC's  1978  Program/Budget  data.  Section 

IV  presents  the  test  results  and  analysis,  which  were 
designed  to  examine  and  demonstrate: 

- the  applicability  of  the  technique  for  resource 
allocation  problems 

- the  applicability  of  the  technique  for  program 
evaluation  against  operating  constraints  and 
organizational  goals 

- the  sensitivity  of  the  model  to  changes  in  administrative 
priorities 


1.5  SUMMARY  OF  RESULTS 


1.5.1  General  Study  Results 

The  principal  objective  of  the  study  has  been  to  determine 
the  application  potential  of  the  goal  programming  technique  for  DDC. 
In  this  regard,  two  conclusions  have  been  reached: 

• It  appears  certain  that  the  technique  can  be  applied 
usefully  in  a functioning  information  service 
environment  such  as  DDC's.  Procedures  to  demonstrate 
its  use  are  provided  in  Section  IV. 

• The  methodology  appears  to  be  generally  applicable 
to  other  types  of  information  service  organizations, 
particularly  those  oriented  toward  program  planning 
and  budgeting.  Consequently,  the  benefits  of  this 
effort  could  be  extended  beyond  DDC. 

3Lee,  Ibid. 
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1.5.2 


Delivered  Items 


As  a result  of  this  study,  DDC  has  been  provided  with  the 

following: 

• An  objective  method  for  program  evaluation  in  which 
one  of  the  principal  benefits  is  a procedure  to 
clarify  and  resolve  apparent  goal  conflicts  existing 
among  various  levels  of  management. 

t A basic  goal  programming  model  specifically  designed 
for  use  in  evaluating  DDC's  program  oriented  plans 
in  an  organizational  goal  context. 

• A FORTRAN  program  for  solving  goal  programming  problems, 
which  have  been  installed  and  run  on  DDC's  computer  system 
(see  Appendix  D) . 

• Insight  to  the  complexity  of  the  agency's  decision- 
making environment. 

• Analysis  of  DDC's  1978  Program/Budget  which  was  used 
as  a source  of  data  in  this  study. 

1.5.3  Results  of  the  Administrative  Interviews 

x — 

The  interview  findings  (Appendix  A)  show  a complex  goal 

structure  that  makes  up  DDC's  decision-making  environment.  In  addition 

4 

to  its  line  management  within  the  Defense  Logistics  Agency  , DDC  has 
independent  constituencies  in  the  Office  of  the  Director,  Defense  Research 
and  Engineering,  as  well  as  the  Research,  Development,  Test  and 
Evaluation  Commands  of  the  Army,  Navy  and  Air  Force. 

Administrators  within  these  agencies  reflect  conflicting  goals 
with  regard  to  the  DoD  scientific  and  technical  information  (S&TI)  program. 
The  conflicts  nre  expressed  not  only  between  agencies,  but  often  within 
the  responses  of  individual  administrators. 

In  comparison  to  the  user  need  and  technological  goals  derived 
from  the  10  Year  Requirements  and  Planning  Study,  the  administrators' 


The  Defense  Logistics  Agency  was  formerly  the  Defense  Supply  Agency. 
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goals  for  the  S&TI  program  differ  primarily  on  the  degree  of  systems 
improvement  that  should  be  achieved  by  the  information  program. 
Administrators  arc  relatively  satisfied  with  the  limitations  of  the 
status  quo , users  and  information  professionals  are  not. 

j 

1.5.4  Results  of  the  Model  Building  Effort 

The  results  of  this  study  demonstrate  that  goal  programming 
supplements  DDC's  traditional  decision  making  process  in  these  key 
ways : 

• It  helps  define  the  decision  environment 
in  unambiguous  terms 

• It  provides  systematic  consideration  of 
alternative  decision  strategies,  often 
involving  different  levels  of  management 

• It  ensures  that  all  key  elements  are  considered 
each  time  a decision  strategy  is  evaluated 

• It  creates  a documented  record  of  the  decision  process 

• It  provides  quantitative  solutions  to  management 
problems 

In  addition,  goal  programming's  most  interesting  feature 
is  that  it  helps  decision  makers  establish  priorities  for  proposed 
operating  programs.  Moreover,  it  encourages  them  to  define  goals  that 
justify  information  products,  services  and  projects.  In  this  context 
the  agency's  output  is  clearly  related  to  organizational  purpose.  Thus, 
the  model  provides  a basis  for  information  service  decision  making  in 
which  both  information  professionals  and  general  managers  at  all  levels 
within  the  organization  can  participate  on  an  equal  basis.  Even 
though  no  perfect  decision  making  criterion  may  be  available,  managers 
generally  are  able  to  specify  their  priorities  with  respect  to  organ- 
izational goals.  Thus,  common  grounds  for  discussion  are  obtained  by 
using  the  goal  programming  tool  in  the  manner  demonstrated  in  Section  IV. 

1.6  ORGANIZATION  OF  THE  REPORT 

The  final  report  is  organized  to  document  the  contractual 
effort  as  follows: 
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• Section  II  is  a review  of  the  literature  on 
information  service  quantification  techniques 

• Section  III  is  a goal  programming  model  for  DDC 
planning  and  decision  analysis  with  respect  to 
resource  allocation  problems  and  project  evaluation. 
It  demonstrates  a basic  methodology  for  measuring 
information  services  and  relating  then  to  organ- 
izational goals 

• Section  IV  demonstrates  the  feasiblity  for  using  the 
technique  for  DDC  planning  and  policy  analysis 

Supporting  materials  and  data  are  provided  following  the 


text . 

• The  bibliography  lists  the  documents  used  in  the 
contractual  effort 

• Appendix  A documents  the  administrative  interviews 

• Appendix  B defines  the  mathematical  signs  and 
symbols  used  in  the  goal  programming  model 

• Appendix  C presents  data  tables  used  in  the 
constr\iction  of  the  DDC  goal  programming  model 

• Appendix  D is  a description  of  the  computer  solution 
program  and  the  procedures  for  setting  up 
problems  for  the  computer 
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SECTION  II.  QUANTIFICATION  OF  INFORMATION  SERVICE  GOALS: 

A LITERATURE  REVIEW 

This  section  reviews  the  literature  on  the  quantification  of 
information  service  goals  for  use  in  decision  analysis . the  references,  in 
parentheses,  are  made  to  the  bibliography  at  the  end  of  the  report.  The  review 
is  presented  to  summarize  how  far  the  field  of  information  service  has 
progressed  in  quantitative  decision-making,  and  to  characterize  available 
tools  for  measuring  information  services.  If  goal  programming  is  to  be 
a practical  aid  to  information  service  managers,  it  is  essential 
that  the  managers  become  aware  of  what  available  techniques  for  measuring 
information  services  can  contribute  to  decision  analysis. 

To  serve  this  end,  the  review  concentrates  on  the 
following  topics: 

• Progress  to  date 

• Decision  Models 

• Measurement  of  information  services 

2.1  WHAT  DECISION  ANALYSIS  ENCOMPASSES 

Decision  analysis  may  be  interpreted  in  a general  sense  as 
the  use  of  the  scientific  method  to  solve  management  problems,  or  in  a 
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narrower  sense  as  the  application  of  mathematical  techniques  to 
management.  The  essence  of  decision  analysis  is  model  building.  Decision 
analysis  is  distinguished  from  the  generic  field  of  operations  research, 
(also  called  management  science)  by  its  emphasis  on  the  need  for  an 
integration  of  quantitative  analysis  with  environmental  and  behavioral 
aspects  of  the  decision-making  process.  Therefore,  decision  science 
encompasses  a broader  spectrum  of  the  decision-making  process  than 
the  processes  of  quantification  alone.  It  is  in  the  broader  context 
that  this  review  has  been  conducted. 


2.2  PROCRESS  TO  DATE 

The  literature  of  information  service  quantification  and 
measurement  techniques  strongly  suggests  that  the  field  has  not  pro- 
gressed very  far  into  decision  science.  Measurement  techniques  in  the 
current  literature  concentrate  on  narrow  aspects  of  operating  systems. 
They  usually  lack  the  involvement  of  environmental  aspects  and  organi- 
zational goals  and  objectives.  Thus,  they  are  not  consistent  with 
decision-making  practices  (Debons',  23). 


Most  reviewers  of  the  state-of-the-art  of  quantitative 
evaluation  of  information  services  create  a pessimistic  impression  with 
respect  to  progress  made  to  date  in  collecting  and  using  data  for 
decision-making.  Hindle  and  Raper  (33),  for  example,  conclude  that  the 
achievements  in  quantitative  evaluation  for  analysis  of  informational 
policy  must  be  regarded  as  "disappointing".  They  report  a particular 
lack  of  methods  to  develop  detailed  knowledge  of  resource  allocation 
problems.  In  this  respect,  they  are  supported  by  Ford  (28),  who 
concluded  a review  of  research  in  user  behavior  by  stating  that  "we 
have  measured  almost  every  conceivable  characteristic  of  the  user, 
but  without  any  attempt  to  use  these  data  to  clarify  resource  allo- 
cation issues". 


The  progress  that  is  conceded  applies  to  the  evaluation  of 
public  libraries  and  academic  libraries  (Hamburg,  31;  Bommer  6;  and 
University  of  Durham,  89).  By  contrast,  the  use  of  quantitative 
techniques  for  overall  design  and  evaluation  of  specialized  information 
services,  such  as  I)DC,  appears  to  be  virtually  unexplored  territory 
(Hindle  and  Raper,  33). 
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Despite  such  negativism,  actual  progress  may  be  some- 
what better  than  the  progress  perceived  by  the  reviewers.  Lynch  (5b) 
suggests  that  the  practical  art  of  information  service  management  may 
be  ahead  of  the  research  and  theory.  In  practice,  managers  are  forced 
to  use  intuitive  judgement  and  uncomplicated  quantification  measures  in 
decision  analysis.  In  practice,  they  do  reflect  the  influence  of  their 
operating  environments.  Moreover,  model  building  has  developed  a 
growing  interest  in  the  past  five  years,  although  the  number  of 
practical  applications  are  few.  Bommer  (7)  suggests  the  problem  pre- 
venting more  wide-spread  applications  of  quantitative  techniques  may 
be  that  too  much  attention  has  been  devoted  to  the  construction  and 
solution  of  complex  mathematical  models  which  ignore  the  value  of  simple 
and  direct  measures  that  are  actually  more  useful  to  the  decision- 
maker. Lee  (50),  who  has  specialized  in  applying  goal  programming  models 
to  a wide  variety  of  management  problems,  also  advocates  the  construction 
of  models  which  are  "a  great  deal  simpler  than  reality". 

Furthermore,  techniques  that  serve  more  to  demonstrate  the 
mathematical  prowess  of  the  modeler  than  to  assist  the  decision-maker 
have  a tendency  to  show  up  more  readily  in  the  literature  than  more 
direct  and  pragmatic  techniques,  which  may  partially  account  for  the 
paucity  of  reports  of  practical  techniques  suited  for  decision  analysis 
in  information  service  organizations. 


2.2.1  The  Cause  for  Optimism 

Swanson  (86)  provides  additional  optimism  in  an  extremely 
well  balanced  and  comprehensive  review  of  the  state-of-the-art  of 
evaluation  studies.  Her  only  agreement  with  other  reviewers  is  that 
additional  investigation  into  quantitative  decision-making  is  clearly 
warranted.  She  contends  that  although  the  state-of-the-art  of 
evaluation  studies  is  still  deficient,  the  deficiencies  are  a result 
of  the  embryonic  stage  of  the  field's  development,  combined  with  the 
variety  and  complexity  of  the  decision  environment  it  must  address  in 
evaluating  information  services.  She  concludes: 
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"To  date,  investigators  have  had  the  resources  to  probe 
only  a small  part  of  the  whole,  trying  to  formulate 
methodology  as  well  as  acquire  data.  This  is  seen  as 
an  expected  phenomenon  in  the  emergence  and  development 
of  a body  of  knowledge,  and  more  piecemeal  study  is 
anticipated  before  patterns  appropriate  to  particular 
types  of  study  are  discernible".  (Swanson,  86  p.  154-155) 

The  progress  that  has  been  reported  over  the  past  six  to  seven 
years  is  actually  encouraging  and  impressive  despite  the  fact  that  decision 
analysis  procedures,  definitive  observational  techniques,  units  of  measure  and 
theories  have  not  yet  emerged.  While  it  is  not  yet  possible  for  an  investigator 
or  manager  to  go  to  the  literature  and  find  a "cook  book"  type  of  article 
that  tells  what  to  measure,  how  to  measure  and  how  to  interpret  the  results, 
studies,  such  as  Hamburg's  (31)  for  example,  show  that  the  use  of  measure- 
ment for  decision  making  in  the  information  service  environment  is 
feasible. 


2.2.2  Examples  of  Progress 

Significant  progress  is  noticeable  in  just  the  growing  concern 
being  expressed  for  understanding  the  reasons  behind  measurement.  Par- 
ticularly since  1972,  investigators  have  shown  increasing  awareness  of  the 
importance  of  recognizing  that  different  system  goals  mandate  different 
evaluative  measures.  In  addition,  they  recognize  that  failure  to  discuss 
goals  with  evaluation  provides  only  superficial  indications  of  system 
effectiveness  (Ladendorf,  47). 

Wilson  (96)  describes  1972  as  the  pivotal  year  marking  the 
passage  of  an  era  in  which  management  accepted  on  faith  the  value  of 
information.  By  then,  the  literature  began  to  reflect  a serious  need 
to  measure  the  effects  and  contributions  of  information  products  and 
services.  About  this  time,  the  purpose  of  measurement  took  new  directions 
concerned  with  costs,  benefits,  and  welfare  economics.^ 


Welfare  economics  attempts  to  assess  the  beneficial  consequences  of 
actions  to  groups  or  individuals  served  by  the  actions. 
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The  measurement  techniques  then  available  in  the  information 
service  field  were  inadequate  for  demonstrating  the  purposes  and  effects 
of  information  products  and  services.  Evans,  et.al.  (25)  were  disturbed 
by  the  fact  that  tools  developed  to  that  time  failed  to  make  their  use 
clear.  Of  the  five  to  seven  hundred  studies  they  reviewed,  very  few 
identified  the  goals  or  the  importance  of  a given  service  to  the 
achievement  of  those  goals.  The  early  tools  did  not  indicate  what 
"good"  information  service  provided.  Consequently,  management  inter- 
pretations of  the  quantified  data  was  difficult  and  confusing.  They 
were  further  dismayed  over  a general  lack  of  consideration  for  the  total 
service  program. 

Lancaster  (48)  said  about  the  techniques  available  in  1970 
that  they  may  not  have  been  able  to  measure  the  value  of  what  information 
services  were  doing  but  "what  they  are  doing,  they  are  doing  very  well". 

How  well  they  were  doing  is  debatable  since  he  also  questioned  whether 
it  was  "up  to  us  to  discuss  'ultimates'." 

Very  soon  after  these  reviews,  investigators  began  to  reflect 
the  need  to  consider  the  "ultimates".  Although  the  information  science 
literature  on  evaluation  continued  to  be  dominated  by  studies  on  retrieval 
measures  or  cost  analysis,  the  library  science  literature  produced  a series 
of  outstanding  studies  involving  the  use  of  quantified  measures  for 
evaluation  of  overall  system  performance  measured  against  goals. 

Hamburg,  et.al.  (31)  have  produced  the  most  practical  and 
generalized  methodology  for  overall  information  service  program  evaluation, 
to  date.  They  describe  a framework  for  planning  and  decision  making 
in  which  operations  and  resources  expressed  within  a program  structure 
can  be  evaluated  in  terms  of  exposure  hours.  Exposure  hours  are  the 
consequence  of  library  programs.  Exposure  is  measured  as  the  sum  of 
occurrences  when  individuals  borrow  documents,  use  them  in-house,  obtain 
them  through  interlibrary  loan  or  receive  reference  assistance.  The 
project  goal  was  to  maximize  exposure  hours  for  given  resources.  The 
main  difficulty  they  encountered  was  in  trying  to  express  everything 
in  terms  of  one  measure. 
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DeProspo.  ct.al.  (24)  about  the  same  time  as  Hamburg  took  a 
multidimentional  approach  to  measurement  indicating  various  user  demands 
on  library  resources.  The  factors  they  measure  are  traditional 
library  elements:  hours,  circulation,  use  of  equipment,  and  so  forth. 

This  study  is  an  example  of  the  use  of  uncomplicated,  although  not 
simplistic,  measures  to  provide  meaningful  management  data.  They  do  not 
attempt  to  create  a single  dimension  unit  of  measure,  but  they  make  the 
point  that  while  their  several  measures  indicate  the  use  of  library 
resources,  the  managers  must  determine  whether  these  measures  express 
operational  objectives,  and  if  so,  what  the  criterion  levels  are  for 
satisfactory  operation. 

The  use  of  measures  for  program  evaluation  across  several 
loosely  interdependent  organizations  was  implemented  in  the  academic 
library  environment  by  the  MRAP  (Management  Review  and  Analysis  Program) 
(Webster,  93). 

Bommer  (6)  has  built  upon  the  sophisticated  work  of  Morse  (62) 
and  developed  a management  system  for  effective  decision  making  and 
planning  in  a university  library. 


2.2.3  Implications  for  Current  Investigations 

, Three  significant  conclusions  can  be  reached  as  a result  of 

the  progress  in  information  service  measurement  since  1972: 

1.  Although  it  is  necessary  to  develop  a unique  methodology 
in  order  to  use  quantification  techniques  successfully , 
those  organizations  able  to  commit  sufficient  resources 
to  the  task  can  implement  useful  programs.  There  are  no 
intrinsic  impediments  in  the  nature  of  information 
service  itself  (Hindle  and  Raper,  33;  Leimkuhler  and 
Billingsley,  53;  and  Swanson  86). 

2.  The  complexity  of  decision  making  in  the  information 
service  environment  is  a significant  problem  which 

can  benefit  from  the  use  of  well  planned  quantification 
techniques  (Buckland  10,  Cooper  19,  DeProspo  24, 
and  Millham  59). 
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Although  methodology  (how  to  collect  and  use  measures) 
is  important,  it  is  secondary  to  the  rationale  behind 
a study  (what  to  measure  and  why).  Moreover,  when  quantifi- 
cation is  not  considered  in  relationship  to  goals  and  objectives 
expressed  as  performance  criterion,  no  methodological 
sophistication  can  cure  conceptual  deficiencies  (Swanson 
86,  Smith  and  Wechsler,  81). 

2.3  DECISION  MODELS 


Model  building  provides  the  conceptual  framework  to  coordinate 
all  that  is  known  about  various  aspects  of  an  organizational  environment. 
Therefore,  models  facilitate  decision-making  in  accordance  with  overall 
objectives.  The  term  "model"  is  often  used  loosely  to  refer  to  any 
attempt  to  conceptualize  such  a framework.  However,  for  decision 
analysis  applied  to  this  study,  the  most  useful  models  are  mathematical 
in  nature.  The  use  of  mathematics  is  important  not  only  for  defining 
and  measuring  important  system  variables,  but  also  for  the  power  of 
mathematical  theory  which  helps  maintain  consistent  patterns  of  problem 
conceptualization  throughout  the  decision  analysis  process. 

Mathematical  models  relevant  to  the  DDC  environment  are  reviewed 
in  this  subsection. 


2.3.1  Resource  Allocation  Models 

The  resource  allocation  problem  has  been  addressed  by  Bookstein 
(5).  His  approach  combines  queuing  theory  and  dynamic  programming,  which 
is  not  well  suited  to  the  current  capabilities  of  the  goal  programming 
approach.  Moreover,  the  mathematics  are  somewhat  complex  and  the  data 
needed  to  implement  the  model  need  to  be  determined  through  a systems 
analysis  of  alternative  program  designs.  Consequently,  the  application 
of  the  model  to  routine  problem  solving  is  likely  to  be  limited.  However, 
the  model  is  notable  because  Bookstein  provides  an  interesting  quantitative 
model  of  two  important  information  service  problems:  (a)  the  optimal 

allocation  of  resources  to  sequential  processes  such  as  those  for 
inputing  data  and  documents  into  an  information  system;  and  (b)  the 
optimal  distribution  of  computer  terminals  according  to  work-load 
patterns. 
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Another  relevant  approach  to  the  resource  allocation  problem 
is  suggested  by  Crecine  (20)  in  an  application  from  outside  the  infor- 
mation service  field.  Crecine  looks  at  resource  allocation  in  the  context 
of  a municipal  budgeting  problem.  Using  a simulation  model,  he  describes 
an  approach  to  computer-aided  problem  solving  involving  the  allocation 
of  public  resources  to  proposed  programs  on  the  basis  of  non-market 
factors.  The  approach  is  practical.  It  takes  into  account  the  political 
nature  of  public  resource  budgeting  and  works  on  the  principle  of 
achieving  a balanced  budget  rather  tiian  attempting  to  meet  some  nebulous 
criterion  of  public  satisfaction. 

The  distinction  between  political  choice  and  market  choice  is 
an  important  one  to  remember  in  selecting  practical  performance  criteria 
for  program  evaluation  involving  public  resources.  This  issue  is  further 
explored  by  Raffel  (72)  and  Vickers  (91). 

2.3.2  Information  Center  Location  Problem 

Kraft  and  Hill  (45)  describe  a location  model  for  optimizing  the 

placement  of  information  centers.  The  model  is  formulated  as  a linear 

programming  problem.  It  is  an  interesting  model  because  of  its  possible 
« 

applicability  to  the  problems  of  locating  remote  terminal  access  centers 
for  the  defense  RDT&E  community. 

Kochen  and  Deutsch  (43)  make  an  attempt  at  a general  quantita- 
tive theory  of  decentralization  applicable  to  information  service  fac- 
ilities. They  express  the  number  of  facilities  as  a function  of  demand 
rates,  distances,  speed  and  cost  of  transport,  the  value  of  waiting 
for  results  and  the  costs  of  decentralized  facilities.  The  model  tends 
to  suggest  smaller,  more  numerous  and  more  dispersed  facilities. 

2.3.3  Economic  Models 

Scholz  (80)  recently  described  a methodology  that  could  be 
useful  for  calculating  the  probable  effectiveness  of  various  data  bases 
in  meeting  DDC  user  needs.  This  type  of  data  would  be  helpful  in  deter- 
mining whether  or  not  new  data  bases  should  be  added  to  DDC's  basic 
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service  program.  However,  the  report  is  preliminary  and  its  practicality 
♦ will  have  to  be  judged  after  the  general  model  is  completed. 

Price  (69)  presents  a rather  flexible  model  that  he  claims 
can  be  used  for  a v/ide  variety  of  cost  control  projects. 

A study  currently  in  progress  at  Purdue  University  (71) 
is  directed  toward  a financing  and  pricing  policy  for  industrial 
information  analysis  centers  (IAC).  A broader,  though  less  detailed  view 
of  industrial  IAC  resource  allocation  is  also  reported  for  future  appli- 
cation in  a decision-making  model.  The  model  seems  to  be  inclined 
toward  the  use  of  user  satisfaction  criteria. 

2.3.4  Decision  Models  for  Library  Services 

This  section  highlights  the  more  significant  library  service 
models.  Morse  (62)  provided  the  earliest  significant  work  on  quanti- 
fication of  library  service  for  decision-making.  His  formulations 
address  most  of  the  traditional  library  functions  such  as  book  selection, 
circulation  and  collection  uses.  Morse  recognized  a number  of  limitations 
in  his  units  of  overall  measure  that  use  past  records  of  demand  to  pre- 
dict future  demand.  However,  much  of  the  subsequent  work  on  library 
models  relied  on  Morse  (Bommer  (6);  Hamburg,  et.al.,  (31). 

A second  early  study,  the  PEBUL  project  (Project  for  Evaluating 
the  Benefits  from  University  Libraries,  1969)  demonstrated  that  benefits 
from  libraries  can  be  measured  by  observing  users'  behavior  in  conjunction 
with  administrative  decisions.  In  this  manner  the  PEBUL  methodology 
successfully  applied  quantitative  techniques  to  attributes  of  performance 
(University  of  Durham, (89). 

Hamburg,  et.al.  (31)  developed  an  outstanding  quantitative 
approach  to  the  problem  of  evaluating  information  service  problems  in 
a decision-analysis  context.  They  provide  for  both  behavioral  and  envir- 

/ 

onmental  considerations  in  their  approach  to  optimizing  a measure  of 
exposure  hours  calculated  for  the  various  library  functions.  Their  only 
limitations  are  those  inherent  to  the  unidimensional  aspects  of  measuring 
all  output  of  the  library  in  terms  of  one  unit  of  measure.  The  methodo- 
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logical  difficulty  of  formulating  a very  complex  problem  in  terms 
of  a single  unit  of  measure  was  explored  by  Huber  (34)  as  well  as 
Charnes  and  Cooper  (14).  Investigations  similar  in  methodology  to  Hamburg 
et.al.  were  carried  out  in  the  university  library  context  by  Bommer 
(6),  Bucklnnd  (8),  Burr  (12),  and  Kantor  (37). 

A number  of  investigators  addressed  the  problem  of  how  to 
structure  a program  in  order  to  make  the  most  from  available  resources. 
Urquhart  (90)  discusses  the  broad  prospects  for  information  services 
in  competing  for  national  resources  and  suggests  that  planning  must 
be  dictated  by  the  limited  available  resources.  Millham  (59)  and 
Rouse  (75)  describe  models  for  the  public  library  and  a university 
library  respectively  to  assist  in  conducting  a trade-off  analysis  among 
alternative  programs  measured  against  a set  of  management  criteria, 

NELINET  used  operations  analysis  of  its  internal  processes  in 
combination  with  a market-research  methodology  to  evaluate  potential 
products  and  generate  data  that  were  used  to  make  decisions  about  its 
line  of  products  and  services  (New  England  Board  of  Higher  Education,  64). 

2.3.5  The  Coal  Programming  Approach  to  Model  Building 

Goal  programming  as  described  by  Lee  (50)  was  selected  as  the 
decision  analysis  technique  to  be  the  subject  of  this  study  because  it 
is  a relatively  new  technique  that  has  the  wide  application  potential 
of  linear  programming  but  is  a great  deal  more  flexible.  Moreover, 
goal  programming  permits  the  simultaneous  consideration  of  multiple 

3 

goals  which  is  highly  consistent  with  actual  DDC  management  practice. 

Where  a decision  analysis  model  is  to  be  used  in  a complex  manage- 
ment environment,  the  quantitative  technique  used  should  be  capable  of 
handling  multiple  decision  criteria.  The  linear  programming  technique 
of  mathematical  modeling  has  a limited  value  for  problems  involving 
multiple  goals. 


The  principles  of  goal  programming  are  discussed  in  Section  III,  but 
for  comprehensive  comparison  of  goal  programming  versus  linear  pro- 
gramming see  Lee  (50). 
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The  problem  Is  apparent  In  the  information  service  environment 
when  one  considers  that  the  unidimensional  nature  of  the  work  of  Hamburg, 
et.al.  (31)  is  the  major  practical  limitation  in  that  significant  effort. 

To  overcome  the  unidimensional  nature  of  the  model , it  is  necessary  to 
convert  incompatible  goals  such  as  cost,  circulation  and  document 
access  into  one  criterion,  namely  exposure  hours.  In  a practical  sense, 
it  is  extremely  difficult  to  measure  such  incommensurate  goals  as  a 
single  unit  of  measure,  namely  a utility  function.  Thus,  decision 
making  based  on  models  employing  utility  functions,  is  feasible  more  in 
theory  than  in  practice. 

While  a comprehensive  review  of  goal  programming  is  not  within  the 
scope  of  this  review,  a brief  history  of  the  evolution  of  the  technique 
is  provided  for  the  reader  who  wishes  to  understand  its  origins. 


2 . 3 . 5 . 1 The  Evolution  of  Goal  Programming 

Goal  programming  is  derived  from  linear  programming.  It 
emerged  from  the  work  of  Charnes  and  Cooper  (14)  in  the  1950 's.  The 
name  was  given  to  the  technique  in  their  well  respected  book  on  appli- 
cations of  linear  programming  to  industrial  problems.  The  concept  of 
programming  to  goals  first  emerged  as  an  issue  for  unsolvable  linear 
programming  problems.  Charnes  and  Cooper  describe  the  concept  as 
follows : 


"Closely  related  to  the  analysis  of  contradictions  in 
unsolvable  problems  is  the  issue  which  will  be  called 
"goal  attainment."  Management  sometimes  sets  such  goals 
even  when  they  are  unattainable  within  the  limits  of  avail- 
able resources  for  a variety  of  reasons. .. Any  constraint 
incorporated  in  the  functional  will  be  called  a "goal". 
Whether  goals  are  attainable  or  not,  an  objective  may 
then  be  stated  in  which  optimization  gives  a result  which 
comes  as  close  as  possible  to  the  indicated  goal." 

(Charnes  and  Cooper,  ( 14)p . 215-216) . 

Charnes  and  Coopers'  role  was  primarily  in  popularizing  linear 
programming  through  their  success  in  formulating  a wide  variety  of 
problems  using  linear  programming  techniques.  As  a result,  the 
practicality  of  using  linear  programming  for  managerial  decision-making 
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was  firmly  established. 

The  origins  of  linear  programming  can  be  traced  far  back  in 

4 

mathematical  history  to  the  theories  of  linear  and  non-linear  equations. 
However,  in  modern  history,  George  Danzig  is  credited  as  the  "father  of 
linear  programming" (Lee , 50). 

Danzig's  work  was  primarily  in  the  search  for  techniques  to 
solve  logistics  problems  for  military  planning.  He  formally  introduced 
the  "simplex  method"  for  calculating  solutions  to  linear  problems  at  a 
195.1  Conference  sponsored  by  the  Cowles  Commission  for  Research  in  Econo- 
mics (Koopmans,  44). 

People  recognized  by  Danzig  as  instrumental  to  his  success  were 
his  associates  Marshall  K.  Wood,  Leonid  Hurwicz,  and  Tjalling  C.  Koopmans. 
Also,  he  cited  the  work  of  John  Von  Neumann  in  game  theory  (Danzig,  22; 
Koopmans,  44). 

More  recently,  the  acceptance  and  utility  of  linear  programming' 
was  enhanced  bv  the  work  of  Charnes  and  Cooper  (14).  Then,  the  goal 
programming  aspects  were  improved  by  Ijiri  (13)  who  added  the  concept  of 
pre-emptive  priorities  to  the  solution  of  conflicting  goals'*.  Contini  (18) 
examined  the  goal  programming  method  under  conditions  of  uncertainty 
(stochastic  methods).  Jaaskelainen  (36)  used  goal  programming  to  solve 
production  planning  problems.  Pitkanen  (67)  explored  goal  programming's 
application  to  public  administration  and  Ruefli  (77)  has  been  working 
with  Charnes  on  the  application  of  linear  programming  to  the  popular 
Planning-Programming-Budgeting  System  (PPBS)  in  which  gi  il  i«-ogramming 
is  likely  to  apoly.  Trinkl  (87)  has  also  explored  the  applicability  of 
goal  programming  to  PPBS. 

Lee  (50)  has  become  a major  contributor  to  the  practical  appli- 
cation of  goal  programming  to  real  world  problems.  He  provides  numerous 


A 

For  a general  presentation  of  the  basic  principles  of  linear  programming 
see  Churchman  (15). 

JThe  significance  of  pre-emptive  priority  is  made  clear  in  Section  III. 
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examples  of  model  formulation  and  goal  quantification  techniques  to 
serve  as  guides  when  formulating  new  problems.  In  addition,  he  provides 
a FORTRAN  computer  program  based  on  the  simplex  method  for  calculating 
solutions  to  goal  programming  problems.  It  also  features  Ijiri's 
principle  of  pre-emptive  priority  for  finding  optimal  solutions. 

Lee  appears  to  have  made  a significant  contribution  to  decision 
science  by  making  goal  programming  a practical  management  tool  for  use 
by  imaginative  investigators  and  managers. 

2 . 4 MF.ASL'RF.MF.NT  OF  INFORMATION  SERVICE 

Measurement  is  important  in  the  decision  analysis  process 
because  it  provides  the  content  of  the  mathematical  formulations  of  the 
model.  Numerical  data  serve  to  establish  quantitative  relationships 
among  the  components  of  the  decision-making  system  represented  by  the 
model.  Too  often,  the  functional  nature  of  measurement  is  overlooked 
and  an  unwarranted  mystique  is  attributed  to  the  numbers  holding  them 
to  be  absolute  values.  What  is  needed  for  decision-making  is  the  simplest 
measures  which  will  suffice  for  deriving  pragmatic  relationships  in 
the  decision  problem. 

The  point  was  made  previously  in  this  report  that  standard 
measurement  techniques  for  evaluating  information  service  programs  do 
not  exist.  Neither  is  there  concensus  on  the  type  of  measurement 
techniques  appropriate  to  particular  types  of  study.  Consequently,  it 
is  not  possible  to  clearly  relate  the  measurement  techniques  reported 
in  the  bibliography  to  DDE  problems.  Nor  is  it  possible  to  obtain  from 
the  literature  measures  of  information  services  which  are  universally 
applicable  to  the  goal  programm'ng  approach.  Therefore,  studies  which 
attempt  to  measure  information  service  factors  in  a scientific  fashion 
have  been  included  in  the  bibliography  mostly  to  serve  a reference 
function  and  stimulate  DDC  management's  thinking  about  meaningful 
quantitative  techniques  for  use  in  decision  analysis  of  problems 
that  arise  subsequent  to  the  present  effort. 

Nevertheless,  to  employ  quantitative  techniques  on  a practical 
level,  it  is  important  for  the  information  service  manager  to  understand 
the  characteristics  of  valid  measures  and  also  to  consider  the  types  of 
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measures  that  have  been  employed  usefully  in  other  goal  programming 
formulations . 

2.4.1  Characteristics  of  Valid  Measures 

2.4.1. 1 Functionality  of  Measurement 

Quantification  in  evaluation  is  often  looked  upon  as  a means 
of  ensuring  objectivity  in  the  evaluative  process.  Certainly,  it  is 
an  aid  in  that  respect  but  quantification  alone  will  not  ensure  it.  Nor 
is  objectivity  related  to  the  exactness  of  the  measures  used.  The 
nature  of  measurement  is  characterized  by  Kaplan: 

"Measurement,  in  short,  is  not  an  end  in  itself. 

Its  scientific  worth  can  be  appreciated  only  in  an  instru- 
mentalist perspective,  in  which  we  ask  what  ends  measurement 
is  intended  to  serve,  what  role  it  is  called  upon  to  play 
in  the  scientific  situation,  what  functions  it  performs  in 
inquiry. 

"The  failure  to  recognize  this  instrumentality  of  measurement 
makes  for  a kind  of  mystique  of  quality,  which  responds  to 
numbers,  as  though  they  were  the  repositories  of  occult 
powers."  (Kaplan  38,  p.  171-172). 

In  a later  passage,  Kaplan  adds  that  "exactness  is  not  as 
important  for  scientific  status  as  is  objectivity." 

Ihus,  measures  are  seen  to  be  instruments  in  decision  analysis 
and  a variety  of  techniques  may  be  equally  appropriate  for  a given 
situation  and  purpose.  The  validity  of  the  measure  according  to  Kaplan 
(38)  rests  in  whether  the  measure  has  value  to  those  using  it  and 
they  can  "do  something  meaningful  with  it."  Thus,  the  first  characteris- 
tic of  valid  measurement  is  that  validity  depends  on  the  context  in 
which  the  measurement  is  used  and  the  inferences  taken  from  it. 

2 . 4 . 1 . 2 Quantified  Evaluation 

Quantification  used  for  evaluation  is  merely  the  use  of 
numbers  to  measure  value.  Inherently,  it  involves  a combination  of  bas- 
ic assumptions  underlying  the  activity  being  evaluated.  Thus,  for 
evaluation,  measures  represent  approximations  of  value  (Suchman,  83). 
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Certainly,  to  transform  qualitative  information  service  values 
into  measurable  factors  requires  a reasonably  precise  definition  of 
"qualities"  such  as  comprehensiveness,  timeliness,  accessibility  and  user 
satisfaction.  Precision  in  this  sense  means  to  artificially  establish 
a value  scale.  Evaluative  measurement  can  then  be  made  in  ordinal  or 
comparative  terms  if  need  be.  Such  measures  may  lack  exactness,  but 
if  they  are  used  objectively  they  are  valid  in  a true  scientific 
sense . 

Consequently,  a second  characteristic  of  valid  measurement  is 
that  it  may  have  a subjective  basis  if  the  measures  are  applied  uniformly. 

2.4.2  Measures  Useful  in  Decision  Analysi s 

Decision  analysis  does  not  substitute  for  judgement  in  decision- 
making. The  value  of  intuitive  judgement  based  on  the  experience  of  the 
decision  maker  who  has  proved  his  ability  is  a valid  source  of  measures 
useful  in  decision  analysis.  Numerical  procedures  may  include  very 
primitive  measures  based  on  management  judgement  or  measures  derived 
through  a very  systematic  analysis.  In  fact,  the  process  of  decision 
analysis  may  help  refine  an  initial  set  of  measures  based  solely  on 
management's  intuitive  judgement  to  a well  scaled  measurement  system. 

Numerical  procedures  are  based  on  three  steps: 

1.  Assignment  of  measures  of  value  to  the  decision 
variables  expressed  in  the  form  of  a mathematical 
model  which  establishes  relationships  among  the 
variables 

2.  Analysis  of  model  solutions 

3.  Selection  of  the  set  of  values  for  the  decision 
variables  that  yield  the  most  satisfactory  solution 

An  iterative  trial  and  error  analysis  employing  alternative  measurement 
schemes  may  well  result  in  a sharpened  perception  of  a decision 
problem  leading  to  a measurement  system  particularly  meaningful  for 
some  operational  function  that  had  not  been  quantified  previously. 

(Lee  50) . 

Decision  analysis  takes  a pragmatic  approach  to  quantification.  It 
employs  measures  of  only  the  essential  elements  of  the  problem  being 


modeled,  and  then  using  the  modeling  process,  searches  for  a formulation 
to  use  the  available  data  (Lee,  50).  Consequently,  the  development 
of  a practical  decision  analysis  model  need  not  wait  until  exact 
measurement  schemes  are  developed  to  fit  the  decision  problem.  The 
main  prerequisite  for  using  the  pragmatic  approach  to  measurement  is 
that  management  must  be  willing  to  express  at  least  an  ordinal  impor- 
tance for  goals  in  a linear  decision  system. 


2.4.3  Measures  for  Coal  Programming 

Pitkanen  (67)  describes  a very  intesting  application  of  goal 
programming  in  the  area  of  policy  analysis  relevant  to  the  DDC  environ- 
ment. This  model  was  concerned  with  setting  goals  related  to  public  ex- 
penditure decisions.  Pitkanen  regarded  the  quantification  problem  as 
one  of  setting  targets  for  desired  levels  of  resource  utilization  from 
several  pools,  and  targets  for  output  in  terms  of  consumption  goods 
and  services  (those  that  are  part  of  the  basic  public  program)  and 
investment  goods  and  services  (those  designed  to  improve  the  services 
themselves).  The  focus  of  his  study  was  on  establishing  priorities  for 
various  incompatible  and  incommensurable  objectives.  Pitkanen 
emphasized  that  the  goal  programming  approach  had  general  applicability 
in  public  administration  by  ensuring  that  in  the  planning  process,  the 
goal  setting  problem  would  go  before  the  detailed  preparation  of  the 
plans.  Coincidentally,  Mintzberg  et.al.  (60)  pointed  out  the  signifi- 
cance of  Pitkanen' s observation  following  an  intensive  study  of  25 
strategic  decisions.  They  conclude  that  organizations  tend  to  formulate 
only  one  fully  detailed  option  to  submit  for  evaluation.  They  find  that 
goals  tend  to  be  formulated  with  precision  after  the  decision  has  been 
made  and  not  before. 

Gibbs  (30)  used  goal  programming  in  the  situation  where  a 
corporate  computer  systems  and  planning  group  desired  to  develop  a 
training  program  for  its  systems  analysts.  His  model  solved  a resource 
allocation  problem  with  respect  to  the  use  of  contract  services  versus 
in-house  staff  based  on  relative  cost  and  effectiveness  measures.  Gibbr. 
used  a standard  linear  programming  computer  solution  package.  Therefore, 
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in  order  to  give  priorities  to  his  goal  statements,  he  had  to  provide 
a weighted  measure  of  the  relative  value  of  each  goal  rather  than  a 
simple  ordinal  ranking.  However,  his  model  did  provide  valid  solutions 
to  the  problem  he  posed. 

Lee  (50)  provides  the  most  comprehensive  set  of  applications 
of  goal  programming  to  practical  problems.  The  list  of  his  accomplish- 
ments includes: 

1.  Production  Planning  - the  production  of  record  players 
and  tape  recorders. 

2.  Financial  Planning  - management  of  capital  structure, 
dividend  payout  policy,  and  growth  of  earnings  over  a multi- 
time phase  period. 

3.  Mutual  Fund  Portfolio  Selection  - to  account  for  expected 
return  and  market  volatility. 

4.  Management  Decisions  - the  scheduling  of  management  and 
sales  force  staff  in  a specialty  shoe  store. 

5.  Media  Planning  - the  allocation  of  resources  to  advertising 
programs  for  the  promotion  of  sales. 

6.  Corporate  Planning  - overall  management  planning  of 
revenue  and  expenditures  in  a public  utility, 

7.  Academic  Planning  - resource  allocation  of  various  classes 
of  labor  to  meet  set  criteria  of  accreditation  and  program 
budget  requirements. 

8.  Decision  Analysis  in  Government  - a multi-year  model  for 
revenue  expenditure  and  capital  improvement  planning  in 
a small  city. 

9.  Budgetary  Planning  in  Health  Care  Clinics  - the  allocation 
of  various  classes  of  labor  resources  to  program  goals. 

10.  Resource  Allocation  in  Hospital  Administration  - a multi- 
year mod.  1 for  long  range  planning  at  a 200  bed  hospital 
in  a small  city. 

Of  Lee's  models,  the  academic  planning-resource  allocation  model 
(Lee,  51)  seems  to  provide  the  most  applicable  approach  to  the  kind  of 
decision  environment  identified  in  the  Administrative  Goal  Survey  that 
was  the  initial  task  of  the  present  study. 

Lee's  models  include  a wide  variety  of  application  areas  which 
could  be  applied  to  analogous  problems  in  information  service  organiza- 
tions such  as  DDC.  Each  model  characterizes  a complex  set  of  widely 
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varied  and  competing  goals  as  well  as  a methodology  for  quantifying 
the  essential  factors  involved  in  the  decision  problem.  The 
diversity  exemplified  by  the  list  demonstrates  the  range  and  flexibility 
of  the  goal  programming  decision  analysis  technique. 
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SECTION  III.  A GOAL  PROGRAMMING  MODEL  FOR 
DDC  PROGRAM  EVALUATION 


3.1  INTRODUCTION 

This  section  presents  a general  goal  programming  model  for 
program  evaluation  in  DDC's  decision-making  environment. 

Goal  programming  uses  a mathematical  approach  to  resolve 
decision  problems.  Its  main  feature  is  mathematical  model  building. 

From  the  outset  &f  the  model  building  effort,  the  decision 
problem  is  conceptualized  in  mathematical  form. 

The  model  is  complete  when  the  entire  decision  problem  is 

arrayed  as  a matrix  of  measurable  factors  consisting  of  a set  of 

equations  with  goal  criteria*  on  the  right  hand  side  of  the  equations 

2 

and  the  relationships  of  the  decision  variables  to  the  goal  criteria 
expressed  on  the  left  hand  side. 

*Goal  criteria  as  used  in  this  report  are  numerical  constants  that  rep- 
resent quantified  performance  goals  against  which  program  evaluation 
analysis  can  be  made. 

2 

Decision  variables  are  the  program  resources  under  the  decision- 
makers control. 
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It  is  the  purpose  of  this  section  to  present  such  a matrix 
relevant  to  DDC. 

Measurement  is  important  as  providing  meaningful  content 
(meaningful  to  the  decision-maker)  for  the  mathematical  forms  which  are 
employed.  For  example,  the  goal  criteria  must  be  defined  in  such  a way 
that  they  allow  a means  for  quantitative  evaluation  of  DDC's  organizational 
and  administrative  goals.  Moreover,  relationships  within  DDC's  decision 
environment  and  DDC's  operating  program  must  be  quantitatively  related  to 
organizational  and  administrative  goals. 

Frequently,  descriptions  of  quantitative  analysis  techniques 
are  initially  confusing.  This  is  perhaps  due  to  the  symbolic  notation 
required  to  formulate  the  problem  under  consideration.  As  the  DDC  model 
is  developed,  hopefully,  this  confusion  will  be  cleared  up.  In  an 
effort  to  alleviate  this  inherrent  problem.  Appendix  B is  provided  to 
define  some  of  the  arbitrary  signs  and  symbols  used  in  the  notation. 

In  addition,  the  following  introductory  sub-sections  will  review  the 
concept  of  model-aided  decision-making  in  a functioning  organization, 
establish  the  DDC  context  of  the  program  evaluation  model , and  explain 
the  general  goal  programming  model  form.  Following  the  introductory 
material,  the  model  developed  for  DDC  is  presented. 

3.1.1  Organizational  Coals  and  Model-Aided  Decision-Making 

Figure  3-1  is  a functional  diagram  of  the  organizational 
decision-making  environment  of  a service  unit  in  a bureaucracy.  It  shows 
that  organizational  decision-making  begins  with  a need  to  do  something. 

At  the  highest  level  the  need  results  in  the  creation  of  the  organization 
itself.  All  other  decisions  are  hierarchically  related  to  the  need 
which  created  the  organization  in  the  first  place. 

The  organizational  needs  can  be  stated  as  goals  and  these 
too  are  hierarchical.  Administratively,  the  goals  translate  into  a 
set  of  programs  intended  to  carry  out  the  goals. 

As  the  diagram  shows,  the  goals  are  concerned  with  why  an 
organizational  program  is  being  carried  out,  not  the  means  by  which 
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Figure  3-1.  Organizational  Decision  Making  Environment 


it  is  done.  Consequently,  a goal  program  structure  meaningful  to 
organizational  decision-making  must  be  one  stated  in  terms  of  why  a 
program  exists  or  is  being  proposed,  rather  than  how  an  administrative 
unit  will  accomplish  some  task,  if  the  goal  program  is  to  have  meaning 
at  administrative  levels  superior  to  the  operating  unit. 

It  should  also  be  noted  that  because  of  the  hierarchical 
nature  of  an  organizational  goal  structure,  goals  are  introduced  into 
the  system  at  many  points  in  the  organization.  It  is  not  surprising 
then,  that  valid  organizational  goals  are  often  competitive  and  con- 
flicting at  the  point  where  they  must  be  translated  into  operating 
programs . 

The  program  administrator's  job,  in  this  instance  the  DDC 
Administrator,  is  to  balance  the  use  of  available  resources  among  various 
processing  operations  and  satisfy  as  many  organizational  goals  as 
possible. 

For  an  information  service  unit  this  means  the  output  of  pro- 
ducts and  services.  The  input  consists  of  staff,  computer  resources 
and  purchased  materials.  At  DDC  this  constitutes  the  annual  Program/ 
Budget . 

The  administrator  may  use  experience,  intuition,  data  or  all 
three  to  make  program  decisions,  which  involve  weighing  the  probable 
consequences  of  alternative  actions  and  choosing  a course  of  action 
"best”  for  a given  situation.  The  process  is  part  management  art  and 
part  science.  The  artful  process  by  which  a program  is  conceived,  is 
paramount.  Management  science  supplements  the  art  by  making  data  and 
facts  available  to  the  manager  to  aid  the  decision-making  process. 

3 . 1 . 1 . 1 Role  of  the  Decision- Analysis  Tool 

The  decision  analysis  model  is  a management  science  tool  that 
can  supplement  t ie  traditional  decision  process  in  these  key  ways: 

• It  provides  a means  of  defining  the  decision  environment 
by  establishing  a working  cause  and  effect  relationship 
between  resources,  processes,  output  and  goals. 
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• It  provides  a means  of  systematically  considering 
a wide  variety  of  alternative  decision  strategies, 
including  the  reordering  of  goal  priorities,  the 
realignment  of  resource  allocations,  the  consequences 
of  increasing  or  decreasing  the  level  of  resource 
categories . 

• It  ensures  that  all  key  elements  in  the  decision 
environment  are  considered  each  time  a decision  is 
inside  red. 

• Model-aided  decision-making  creates  a documented  record 
of  the  decision  process  at  each  level  in  the  adminis- 
trative negotiations  required  to  arrive  at  an  operational 
plan.  Such  a record  can  serve  as  a measure  of 
accountability. 

• As  a mathematical  model,  it  will  provide  quantitative 
solutions  to  management  problems  such  as  the  total 
budget  requirements  to  meet  all  goals,  and  the  number 
of  resources  that  should  be  allocated  to  programs. 

• A goal  programming  model's  most  interesting  feature 
is  that  it  helps  establish  priorities  for  proposed 
operating  programs.  This  feature  is  demonstrated  in 
Section  IV. 

3.1.2  Steps  to  Implementation  of  the  Goal  Programming  Model  at  DDC 

In  order  for  a decision  analysis  model  to  be  practical  in  the 
DDC  context,  it  must  be  flexible  enough  for  DDC's  environment  and  must 
be  capable  of  reflecting  the  management's  judgements  in  lieu  of  objec- 
tive measures  of  value  for  information  products  and  services.  In 
addition,  the  contributions  of  various  program  projects  to  goal 
attainment  must  be  considered  in  making  resource  allocation  decisions 
among  projects  - particularly  when  new  projects  are  to  be  introduced. 
Finally,  it  must  be  able  to  consider  the  overall  DDC  program  in 
program  evaluation  analysis. 

The  goal  programming  approach  to  decision  analysis  meets 
these  criteria.  However,  it  requires  (1)  a definition  of  organizational 
goals;  (2)  a definition  of  organizational  objectives;  and  (3)  a quan- 
titative representation  of  the  real  decision  problem  in  symbolic 
mathematical  form.  With  these  inputs  the  goal  programming  model  is 
used  to  analyze  real  decision  problems  and  calculate  solutions. 
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It  should  bo  recognized  that  a mathematical  model  should 
be  a great  deal  simpler  than  reality  to  undersfand  and  manipulate. 
Otherwise,  it  would  be  no  more  useful  in  decision-making  than  dealing 
directly  with  the  problems.  Thus,  the  model  solutions  must  be  con- 
sidered as  approximate  solutions  subject  to  management  interpretation 
in  the  real-world  environment. 

3 . 1 . 2 . 1 Inputs  to  the  Mode  1 

The  goal  programming  model's  parameters  were  derived  by  AAI 
from  analysis  of  the  results  of  the  administrators'  goals  survey 
summarized  in  Appendix  A.  The  survey  results  were  augmented  in  sub- 
sequent discussions  with  DDC  managers.  Essentially,  the  administrators' 
goals  were  assumed  to  be  organizational  goals. 

Organizational  goals  inferred  from  the  administrators'  inter- 
views  were  made  functional  for  goal  programming  analysis  by  (a)  devising 
a goal  structure  (Table  3-1)  to  provide  a conceptual  framework  for  relating 
f DDC  products  and  services  to  organizational  goals,  and  (b)  working  with 

DDC  to  list  operational  objectives  (Table  3-2).  The  operational  objectives 
specify  the  goals  in  order  that  the  degree  of  attainment  can  be  evaluated. 

The  next  step  leading  to  the  goal  programming  model  formulation 
is  to  define  decision  variables  and  goal  criteria  as  factors  of  organi- 
zational goals  and  objectives.  For  this  study,  the  decision  variables  are 

4 

essentially  the  program  projects  in  the  DDC  Program/Budget  . A complete 
table  of  the  decision  variables  for  this  study  is  provided  as  Appendix  C, 
Table  C-l. 

DDC  chose  to  use  the  data  for  the  1978  Program/Budget  in 

this  effort.  The  model  can  be  used  with  any  year;  but  of  course,  the 

variables,  goal  criteria  and  some  of  the  constraints  might  he  different. 

In  fact,  any  project  list  meaningful  to  DDC  management  can  be  utilized  as 
_ - ‘ 

"Functional"  means  that  the  Administrator's  goals  and  DDC  products  could 
be  correlated  using  the  goal  structure  as  a common  point  of  reference. 

4 

Defense  Documentation  Center,  Research,  Development,  Test  and  Evalua- 
tion (RDT&E)  Program/Budget,  Fiscal  Years  1976/1977/1978.  27  August 
1976.  Defense  Supply  Agency,  Department  of  Defense,  Washington,  I).C. 


33 


AAI 


Coa  1 1 : 


ioal  : 


Coni  3: 


1 : 


jj 


» 

Source 


fABLE  3-1. GOA1  STRUCTURI  FOR  DECISION  ANALYSIS 5 


Projects  to  Aid  in  Identifying  and  Locating  Information  ns 
Opposed  to  Documents  (Ilnsic  and  Investment  effort  Desired) 

• To  RDT&E  MajijU’.ers 

• To  Sc  Lent i ts  and  Engineers 

Projects  to  Provide  Access  to  I)DC  Held  Documents  (Basic  ar.d  Investment 
Effort  Desired) 

• To  RDT&E  Man.;  ;e  rs 

• in  Scientist  s and  Engineers 

• To  Non-DoD  Users 

Projects  to  Provide  Access  to  Documents/Information  from 
Remote  Locations 


Projects  to  Promote  Use  of  Information  Products  and  Services 

• Among  RDT&E  Managers 

• Amonp  Sc i on  t i s t s a nd  rs 

• 


Admin  is t ration 

• To  Administer  DDC  Services 

• To  Plan  DDC  Services 

• To  Prepare  Programs,  Projects  and  Budgets 

• To  Set  Target  Lev<  J for  the  Output  oj  Products  and  Servi 

• To  Provide  Systems  Support 


of  data:  derived  front  Administrators'  interview  (Appendix  A). 
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TABLE  3-2.  DDC  OPERATIONAL  OBJECTIVES  6 


Maintain  the  necessary  resources  to  produce  a basic  level 
of  products  and  services. 

2.  Provide  resources  for  investiment  projects  intended  to  improve 
the  present  level  of  service. 

3.  Utilize  contract  services  to  supplement  in-house  staff  if 
necessary. 

A.  Reduce  the  DDC  costs  for  input  activities  relative  to 
output  costs. 

5.  Provide  resources  to  analyze  and  promote  use  of  DDC's  products 
and  services. 

6.  Except  for  major  equipment  acquisitions,  limit  budget  increase 
requests  to  no  more  than  5-10%  in  any  one  budget  planning  period. 


'^Source  of  data:  Selected  in  concert  with  DDC  management. 
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decision  variables  in  the  model  in  later  applications  so  long  as  the 
data  appropriate  to  a given  list  are  input  to  the  model. 

The  goal  criteria  are  numerical  constants  representing 
quantified  performance  goals.  They  are  set  by  management  and  specify 
how  management  wants  to  see  the  resources  used.  They  may  be  either 
available  resources  or  specified  rargct  levels.  They  may  also  be  in 
conflict  with  one  another. 

Six  types  of  goal  criteria  related  to  the  administrators' 
goals  and  DDC's  operational  objectives  were  jointly  selected  for  this 
study  by  the  modeler  and  DDC.  The  model  evaluates  proposed  programs 
against  these  criteria: 

• The  labor  resources  in  man-years  available  for  1978 
programs 

• The  Budget  available  for  1978  programs 

• Labor  resources  available  for  projects  to  produce  DDC's 
basic  products  and  services 

• Resources  available  for  proj.ects  to  improve  the  level 
of  DDC  services  as  an  investment  for  the  future 

o Target  levels  for  the  distribution  of  man-years  among 
projects  to  achieve  a balanced  program  considering: 

Services  to  RDT&E  managers  relative  to  scientists  and 
engineers 

Services  to  support  libraries 

Responsiveness  to  the  organizational  goals  identified 
by  administrators  (Table  3-1) 

Responsiveness  to  users 

• Specified  target  levels  for  the  number  of  man-years 
to  be  allocated  to  specific  projects 

The  model  allocates  resources  to  proposed  projects  in  an 
attempt  to  simultaneously  meet  all  stated  goal  criteria.  Where  there 
is  conflict  and  not  all  goals  can  be  fully  served,  choices  will  be  made 
on  the  basis  of  priorities  assigned  to  the  goal  criteria  by  the  Admin- 
ist  rator. 

Through  application  of  goal  programming,  the  DDC  decision- 
makers will  be  able  to  measure  the  soundness  of  a program  relative  to 
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org.inizarion.il  goals,  the  resource  allocation  requirements  for  achieve- 
ment of  the  goals  and  t lie  degree  of  goal  attainment  possible  witli  a 
given  limitation  of  total  resources. 


3. 1.1  • neral  Mathematical Form  of  th<  Progi  • " lei 

Goal  programming  is  a special  version  of  linear  programming 
which  is  a highly  developed  set  of  techniques  and  algorithms  particularly 
useful  for  decision  problems  involving  resource  allocation.  Linear 
programming  is  concerned  with  finding  optimal  solutions  to  problems 
with  linear  objective  functions  and  linear  constraints. 


A linear  programming  problem  must  have  either  a single  objective 
function  (one  "goal"  to  be  satisfied)  or  multiple  objectives,  all  of 
which  can  be  reduced  to  a single  effectiveness  measure  (unidimensionality). 

On  the  other  hand,  goal  programming  handles  multiple  goals  in 
multi-dimensions.  The  difference  is  in  the  form  of  the  goal  programming 
model.  Each  "goal"  is  formulated  as  a "constraint”.  The  left  hand  side 
of  the  constraint/goal  consists  of  the  decision  variables  and  their  co- 
efficients, plus  negative  and  positive  slack  variables.  The  slack  variables, 
if  they  take  on  any  values  in  the  solution,  indicate  deviations  from  the 
goal  criterion.  The  goal  criterion  is  stated  as  one  number  on  the  right 
hand  side  of  the  constraint  equation. 

The  objective  is  stated  in  terms  of  the  slack  variables  (d^). 
Management  must  specify  the  priorities  of  avoiding  underachievement  and 
ove rachievcment  of  each  goal.  The  objective,  then,  is  to  minimize  the 
total  value  of  the  slack  variables  (represented  by  Z)  designated  by 
management  and  thereby  avoid  deviations  from  the  goal  criteria. 


The  general  goal  programming  model  can  be  expressed 
mathematically  as: 


Minimize  Z 


m 

£ <4  + C,T} 

1=1 


(ob ject i ve) 


Subject  to: 


AijXj  - dt  + dl 


15 1 


(goal /const  raint ) 


3<) 


A A I 


However,  lor  the  purpose  of  explanation,  a somewhat  less 
condensed  version  will  be  introduced  to  show  the  matrix  structure  of: 


AijXj  ~ di  + di  = 


For  example: 

Minimize  Z 


I <4 + di> 


i = l 


Subject  to: 

A1 1 X1  + A12  X2  + *• 


. . + A,  X - dj  + d,  = B 
In  n J 1 1 


A21  X]  + A22  X2  + • • 


• • * A2n  An  " d2  + d2  = B2 


A , X,  + A_7  X,  + + A X„  - d+  + d~ 

ml  1 anz  Z mn  n m m 

Xj , d^,  dt  = 0 for  all  i,  j 


= B_ 


where : 


E|  are  the  m goal  criteria 

X.  are  the  n variables  associated  with  the  m goals.  These 

are  the  variables  of  interest  in  the  problem  (the 
decision  variables,  the  proposed  projects) 

A::  is  an  n x m matrix  of  the  coefficients  on  the  n variables 

which  express  the  relationship  between  decision  variables 
and  the  m goals 

dt  is  the  amount  of  positive  slack  (over  achievement)  in  goal  i 

dT  is  the  amount  of  negative  slack  (under  achievement)  in  goal  i 
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To  form  the  objective  function,  which  is  t he  final  step  in 
completing  the  model,  the  slack  variables  d+  and  dj  must  be  ranked 
according  to  their  preemptive  priorities  from  the  most  important  to 
the  least  important.  In  this  way  the  lower  priority  goal  criteria  will 
be  met  only  after  higher  priority  goal  criteria.  If  there  are  k 
priorities  they  have  the  relationship. 

P1  >:>>  P2  >:>>  ' ' ' >>:>  Pk 

This  means  that  the  minimization  of  the  value  of  d+  and  d^ 

associated  with  P,  will  always  be  considered  less  important  than  the 

k + 

minimization  of  the  value  of  d^  and  dj  associated  with  P^_^ 

A final  note  which  should  be  made  concerning  the  objective 
function  is  that  within  priorities  (each  P^)  further  differentiation 
is  possible  by  assigning  numerical  weights  to  the  various  slack 
variables.  In  this  way,  one  goal's  achievement  could  be  said  to  be, 
for  example,  twice  or  thiee  times  as  important  as  another. 

But  now,  let’s  turn  to  the  DDC  model. 

3. 2 THE  DDC  COAL  PROGRAMMING  MODEL 

The  fundamental  model  has  been  based  on  the  planning  data  for 
the  1978  Program/Budget  and  the  goals  and  objectives  in  Table  3-1  and  3-2. 

The  projects  listed  for  the  1978  program  make  up  the  basic 
table  of  decision  variables.  The  Program/Budget  list  has  been  slightly 
modified  to  call  out  three  sub-projects  of  particular  interest  to  DDC: 

• the  establishment  of  on-line  terminal  service  in  Boston 

• the  establishment  of  on-line  terminal  service  in 
Los  Angeles 

• the  promotional  effort  requiring  4 billets  in  project 
5.1 

The  complete  table  of  the  decision  variables  is  provided  as 
Appendix  C,  Table  C-l.  The  goal  criteria  are  stated  with  their  re- 
spective constraints.  The  source  of  the  data  is  summarized  in  Appendix 
C,  Table  C-2. 
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For  the  model  formulation,  the  following  constraints  are 

derived : 

A.  Total  Number  of  Staff 

The  total  resources  available  in  the  197ft  budget  is  454  man- 
years.  This  is  a desireable  target  level.  However,  among  the 
operational  objectives  it  was  indicated  that  the  absolute  limit  on 
resource  increases  is  10%  over  the  previous  year.  Since  labor  is  the 
dominant  budget  element  in  the  DDC  program.  A constraint  is  formulated 
to  set  the  absolute  limit  of  491  (10%  over  1977)  on  the  number  of 
man-years.  A second  constraint  is  formulated  for  the  more  flexible 
goal  criterion  454. 

Since  it  is  known  that  in-house  positions  are  more  difficult 
to  justify  them  total  dollar  increases,  the  difference  between  454  and 
491  could  be  considered  a recommendation  to  supplement  in-house  staff 
with  contract  staff  should  the  solution  exceed  the  454  goal  criterion. 

• goal  criteria  (a.): 

a^  - maximum  staff  considered  feasible  (491) 

a 2 - desired  number  of  staff  (454) 

A . 1 Maximum  Feasib 1 < ■ S ta f f 

26  45  60 

Z x + Z y,  + Z Zi  + di  = ai  0) 

i= 1 1 1 i=  31  1=51 

A. 2 Desired  Number  of  Staff 


26  45  60 
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where  (for  all  formulations): 

x,  y,  z = man-years  allocated  by  the  model  to  the  i projects 
in  Appendix  C,  Table  C-l  (the  decision  variables) 

i = subscript  to  identify  the  respective  projects  indi- 
vidually. The  numbers  refer  to  those  used  in 
Table  C-l  which  are  based  on  the  project/sub-project 
code  numbers  in  the  I)DC  Prop, ram/ Budget  in  order  to 
aid  managements'  understanding  of  the  model.  The 
subscript  indicates  the  first  project  to  be  included 
in  the  summation  (£)  and  the  superscript  indicate-  the 
last 

a,  = goal  criteria.  The  actual  value  to  be  used  is  in- 
dicated in  parenthesis. 

ck  = deviational  variables.  Note  that  d+  has  been  deleted 
from  the  initial  model  to  indicate  that  any  solution 
in  excess  of  491  would  be  unfeasible. 


B.  Total  Cost 

The  cost  constraint  can  be  assigned  the  lowest  priority  and 
set  to  zero  in  order  to  calculate  the  total  cost  of  achieving  all  other 
goals.  If  the  solution  then  exceeds  a feasible  cost,  a budget  figure 
can  be  entered  as  a goal  criterion  on  the  solution. 

Since  labor  is  the  principal  cost  item  insofar  as  DDC  decision- 
making is  concerned,  the  labor  cost  alone  is  the  most  relevant  cost  fig- 
ure to  use  as  a goal  criterion.  It  is  assumed  that  in-house  and  contract 
staff  costs  are  equal. 

• goal  criterion  (a.): 

33  - Total  Labor  Cost  (zero  or  $8,778,000) 


d3  " d3 


who  re : 

C,  = a one  row  matrix  of  labor  cost  coefficients  (Total 
project  labor  cost/no.  of  man  years).  The  figures 
calculated  for  the  1978  budget  are  shown  in 
Table  3-3. 
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:OSTS  FOR  1978 


X11 

13.92 

X12 

19.85 

X13 

20.0 

x15 

16.0 

X16 

20.0 

x17 

17.0 

X18 

15.  50 

x19 

21.74 

X191 

21.74 

x192 

21.74 

X21 

18.01 

X22 

14.1 

X23 

15.65 

X2A 

17.0 

X25 

25.0 

X26 

21.43 

y 31 

0.0 

y32 

27.0 

y33 

23.60 

y34 

23.0 

y41 

29.80 

y42 

21.71 

y43 

22.05 

y44 

23.0 

y45 

22.16 

Z51 

20.4 

Z511 

20.4 

Z52 

23.84 

z53 

13.0 

Z60 

19.07 

44 

To  calculate  the  total  cost,  the  analyst  needs  to  add 
thi'  value  of  non-labor  costs  to  the  labor  costs  calculated  by 
the  mode  1 : 

Total  Cost  a + (dj  - 1I3)  + (non-labor  costs)  (4) 


C . B as ic  _S er v i ces 

An  effective  basic  program  of  products  and  services  must 
be  maintained  to  keep  the  confidence  and  support  of  the  top  adminis- 
tration as  well  as  supplying  current  service  demands. 

Two  goal  criteria  are  of  interest  to  calculate  the  basic 
service  requirements: 

• goal  criteria  (a^): 

a^  = Proportion  of  the  total  service  program 
desired  for  basic  services  (85%) 

a,.  = No.  of  man-years  available  for  basic  services  (363) 

C. 1 Percentage  of  the  Total  Program  that  is  Classified  "Basic" 

Since:  Labor  Resources  for  Basic  Projects 

Total  Service  Program  Labor  Resources  4 

then:  (Labor  Resources  for  Basic  Projects)  = a^  (Total 

Service  Program  Labor  Resources) 

Formulated  for  the  study  model  this  becomes: 


26 


Z xj  + -80  (y41  + y42)  + -40  >’43  + *50  *44 


-52 


i=  1 1 


26 


45 


y + 7 + 1 

2L  x . Z_  y.  y^2 
L i«l 1 i-31 


+ d4  “ d4 


(5) 
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where  it  is  specified  that  projects  y , y.„,  y/0  and  y.,  have  both 

q 1 ' 4 Z q j 

basic  and  investment  elements  represented  in  their  labor  resources. 

The  respective  proportions  of  basic  service  arc  indicated  in  the 
constraint  and  also  in  Appendix  C,  Table  C-l. 

C.2  Formulation  oj  an  " 1 f feet  ive"  Basic  Propram  Constraint 

The  number  of  man-years  available  for  basic  services  in  1978  is 
targeted  at  363.  If  it  is  assumed  that  there  is  a direct  linear 
relationship  between  labor  input  and  service  output  then  a constraint 
can  be  written  such  that  the  individual  projects  are  allotted  some 
resources  from  the  pool  of  363  according  to  their  effective  contri- 
butions to  meeting  overall  performance  goals. 

Using  the  same  specifications  as  in  equation  (5),  equation  (6) 
can  be  written: 


26 

y 

ifti  Ei*i  + -80  <E41  y*l  + E42  y42)  + 

.40  (1-^3  y^3)  + -50  (F.^  y 44)  + E52  z52  + d5  “ d5  = a5 


(6) 


where  represents  a measure  of  probable  effectiveness  calculated  for 
each  proposed  project.  The  values  of  I'T  that  have  been  calculated  in 
concert  with  management,  are  shown  in  Table  3-4.  The  data  used  to 
calculate  the  elements  of  E.,  e^  and  e^,  are  shown  in  Appendix  C,  Table 
C-3. 

It  is  assumed,  for  the  constraint,  that  DDC  wishes  to  maximize 
service  by  putting  its  resources  into  the  most  effective  programs. 
Projects  with  high  IT  values  will  tend  to  draw  resources  over  those 
with  lower  scores.  For  example,  output  oriented  projects  are  favored 
over  input  projects.  On-line  services  are  favored  over  other  information 
projects.  It  is  not  necessary  to  rely  solely  on  the  effectiveness 
coefficient  (!'..)  to  allocate  resources  to  all  projects.  Some  project 
elements  such  as  administrative  and  support  elements  are  more 
easily  incorporated  into  later  constraints  because  their  effective- 
ness is  difficult  to  measure  directly. 


D . In vest men t So  rvi cos 

If  DDC  is  to  remain  viable  it  must  continually  improve  its 
capabilities  to  meet  the  forecast  for  increased  demands  predicted  by 
the  10  Year  Requirements  and  Planning  Study.  This  requires  the  use 
of  labor  resources  to  improve  its  performance  capabilities  through  de- 
velopment projects. 

The  approach  to  formulating  the  investment  services  constraints 
is  analogous  to  the  approach  for  basic  services.  Two  goal  criteria 
are  considered: 

• goal  criteria  (a^ ) : 

a^  = Proportion  of  the  total  service  program 
desired  for  investment  services  (15%) 

a -j  = Number  of  man-years  available  for  investment 
services  (68) 

\ 

D.  1 Percentage  of  the  Total  Program  that  is  Considered  Investment 

Using  the  same?  approach  as  equation  (5),  equation  (7)  can 
be  written: 
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i = 3 1 


y±  + -20  ^41  + y42}  + -60  y43  + -50  y44  + y 


45 


26 


45 


‘ a6  ( 


Y.  ♦ I „ ♦ 


) + dz:  - dA 

i — yi  + y52  6 6 

1=11  i=  3 1 


(7) 


D. 2 Formulation  of  an  "Effective"  Investment  Program  Constraint 

To  apportion  the  investment  resources  according  to  effectiveness 
weights  the  constraint  for  an  effective  investment  program  is  derived 
in  the  same  fashion  as  formula  (6).  Both  new  and  established  investment 
programs  are  weighted  for  their  contributions  to  an  effective  program 
using  the  same  scale  used  for  the  basic  program  (see  Appendix  C,  Table 
C-3).  The  main  determinants  of  the  effectiveness  coefficients  are: 
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responsiveness  to  organiznt  ion.il  goals  and  the  willingness  of  manage- 
ment to  commit  resources. 

Tabic  3-5  provides  the  data  for  the  constraint: 


34 
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i=31 


l-  i 


+ -20  ^'41  - 41  + E42y42)  + -6°  E/.^^  + 


4 3-  4 3 


.50  E y,,  + E y 

44  44  45^45 


(8) 


where  E.  represents  a measure  of  probable  effectiveness  calculated 
for  each  investment  project.  The  values  that  have  been  calculated 
in  concert  with  management  are  shown  in  Table  3-5.  The  values  of 
e^  and  e^  are  calculated  in  Appendix  C,  Table  C-3. 

E.  in  re.  t bevels  for  Individual  Programs 

ft  is  necessary  to  set  target  levels  for  the  distribution 
of  available  resources  to  specific  projects.  If  there  were  no 
individual  targets,  the  model  would  call  only  for  the  most  effective 
programs  (i.e.  those  with  high  values  of  E^).  these  constraints  will 
provide  resources  to  many  of  the  projects  that  received  low  E^  scores 
but  are  essential  to  projects  with  high  scores.  For  example,  x^ ^ 

(R&T  WUDB  Input)  is  needed  to  provide  (R&T  UUDB  Output)  but  x^, 

E.  score  is  too  low  to  demand  required  resources. 

The  goal  criteria  for  these  constraints  can  be  stated  as  a 
factor  of  workload  estimates,  percentages  of  the  total  resources  which 
should  be  allotted  to  each  project  or  as  simply  the  actual  number  of 
man-years  desired.  Since  the  actual  number  is  provided  in  the  1978 
Program/Budget,  the  actual  number  is  used. 
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a 

8 

= 

Target  level  lor  the  number  of  man-years  alloted 

to  X11 

(13) 

a 

9 

= 

It 

X12 

(13) 

a10 

= 

II 

X]  3 

( 1 ) 

ail 

= 

II 

X15 

( 2 ) 

a 1 2 

= 

II 

X16 

( 1 ) 

aD 

= 

II 

X17 

( 4 ) 

a 14 

= 

II 

X18 

( 2 ) 

a 15 

= 

II 

X19 

(15) 

a 16 

= 

II 

X 1 9 1 ( 2 ) 

al7 

= 

II 

X 1 92  ( 2 ) 

a18 

= 

II 

X21 

(91) 

ai9 

= 

It 

X22 

(10) 

a20 

= 

II 

X23 

(62) 

a21 

= 

r II 

x24 

( 7 ) 

a22 

= 

II 

X25 

( 1 ) 

a23 

= 

II 

X26 

(23) 

a24 

= 

II 

y 31 

(0  ) 

a25 
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II 

y 32 

( 3 ) 

a26 

= 

• 1 

y33 

( 5 ) 

a2  7 

= 

II 

y34 

( 1 ) 

a28 

= 

II 

y4 1 

( 5 ) 

a29 

= 

If 

y42 

( 7 ) 

a30 

= 

It 

V43 

(19) 

a31 

= 

* II 

y44 

(17) 

a32 

= 

II 

y45 

(25) 

a33 

= 

II 

Z51 

(80) 

a34 

= 

II 

Z511( 4 ) 

3 35 

= 

II 

Z52 

(19) 

a36 

= 

II 

Z53 

( 5 ) 

a37 

= 

II 

Z60 

(15) 

The  general  formulae 

■ for  this  constraint  are: 

2b 

23 

Xi-ll  + (dI  " di) 

aj=8 

(9) 

45  - + 

32 

yi=31  + (dj  - V 

aj=24 

(10) 

6° 
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Z i=  5 1 + (di  ' di) 

n j = 33 
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F.  Program  Responsiveness  to  Organizational  Goals  and  User  Needs 

For  the  overall  program  to  be  responsive  to  organizational 
goals,  criteria  must  be  set  to  define  a balanced  program.  These 
criteria  should  describe  all  service  qualities  which  DDC  regards  as 
valid  for  a well-balanced  overall  program,  regardless  of  whether  or 
not  there  are  projects  proposed  to  meet  all  the  goals. 

The  following  constraints  are  designed  to  provide  at  least 
minimum  program  responsiveness  to  all  known  program  requirements.  If 
not  met,  they  will  identify  gaps  in  the  program.  This  formulation 
assumes  that  if  the  desired  labor  resources  are  applied  to  program 
requirements  that  productive  output  will  follow  to  satisfy  the 
requirements.  This  means  that  labor  is  considered  the  main  ingredient 
to  a successful  program. 

Since  organizational  values  change  over  a period  of  time, 
the  goal  criteria  considered  here  must  be  reevaluated  in  each  planning 
period. 

For  the  DDC  Environment,  three  aspects  of  program  responsiveness 
are  considered. 

• The  classes  of  users  being  served 

• Functional  goal  requirements 

• Responsiveness  to  user  needs 
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F.  1 Classes  of  Users  Being  Served 

The  classes  of  users  for  which  management  has  expressed 
particular  concern  are: 

RDT&E  managers 

RDT&E  scientists  and  engineers 
Libraries  and  other  intermediary 
information  agencies 

• goal  criteria  (a^): 

= Desired  ratio  of  (support  for  RDT&E  managers) 
to  (support  for  scientists  and  engineers)  (1:7) 

aT9’  a40’  n41  = "^ie  wor^l°ac*  that  must  be  processed  by 

project  } (Teclinical  Report  Request 
Distribution)  to  provide  service  to 
libraries.  Management  has  specified 
three  criteria  for  this  constraint  which 
will  be  explained  in  F.1.2. 

F.i. 1 Ratio  of  Service  to  Managers/Scientists  and  Engineers 

The  interest  in  providing  services  to  support  RDT&E  managers 
is  significant  among  DDC's  Administrative  Constituents.  It  tias  also  been 
noted  in  the  10  year  requirements  and  planning  study  that  support  to  managers, 
other  than  the  Office  of  the  Director,  Defense  Research  and  Engineering 
is  minimal.  However,  it  is  necessary  to  recognize  that  the  bulk  of 
DDC's  responsibilities  is  related  to  the  technical  report  program  which 
is  principally  useful  to  scientists  and  engineers.  Goal  criteria  a^ 
is  a desired  service  ratio  between  the  two  main  user  classes.  It  should 
be  noted  that  the  1978  Program/Budget  identifies  no  investment  effort 
specifically  to  improve  services  for  managers.  Therefore,  the  model  will 
attempt  to  compensate  for  that  deficiency  in  meeting  this  criterion 
by  allotting  more  resources  to  the  basic  project  designed  for  managers 
that  has  the  highest  K . value  - namely  ^T  Work  Unit  Data  Base. 

The  formula  for  a_„  can  be  derived  from  the  data  in 

JO 

Appendix  C,  Table  C-3  as  follows: 
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n<x  11 


+ x12) 


+ (X 


15 


X16) 


(x17  + x18) 


192 


I 

i=  1 9 


x.  + 

l 


26 


I 

1 = 22 


xi 


+ d 


38 


- d 


38 


38 


(12) 


where  x , xp>  x XH,’  x]7  anc^  XJ8  are  Proiects  for  RDT&E  managers 
and  the  specified  projects,  x^  and  y are  projects  for  scientists 
and  engineers. 


F.1.2  Service  to  Libraries 

One  of  the  most  important  determinants  of  DDC's  performance 
with  respect  to  serving  libraries  is  its  ability  to  process  technical 
report  requests,  project  x^.  Using  the  workload  estimates  of  the 
1978  Program  Budget,  it  is  possible  to  compute  the  productivity  of  a 
man-year  of  effort  for  this  activity  as  follows: 


To 

My 


23 

23 


23 


(13) 


where : 

T°23 

= Total  units  of  output  for  project  2.3 
a planning  period  (366,000) 

in 

My23 

= Total  man-years  input  to  project  2.3 

(62) 

P2  3 

= Productivity  of  a man-year  of  effort 
2.3  (5903) 

in  project 

Then  the  general  constraint  can  be  written: 

P23  X23  + d39  ~ d39  = a39  (14) 


where  a.^  is  the  number  of  technical  reports  X£^  must  be  able  to 
process  to  serve  97%  of  the  estimated  requests  for  1978.  97"  represents 

the  proportion  of  reports  which  are  distributed  to  non-library  users. 

To  specify  that  management  desires  to  be  able  to  process 
from  3%  in  10%  additional  requests  to  serve  libraries,  the  constraints 


54 


arc  writ  ton: 


~ X 

+ d 

- d* 

23  23 

40 

40 

40 

+ 

23  X23 

+ d41 

1 4 1 = 

a41 

where  a,()  specific’s  a desired  capability  of  at  least  3Z  over  that 
needed  to  serve  prime  users  directly,  in  order  to  serve  library 
requests,  and  ^ specifies  a desired  additional  capability  of  at 
most  10%. 

The  goal  criteria  for  equations  (14),  (15)  and  (16)  were 
calculated  from  the  1978  Program/Budget  data.  They  are  shown  in 
Table  6. 


' LI  3-6.  ( IAI  CRI1  F.R1A  FOR  i(  0 LIBR7  RTES 


a . 
J 

Desired  units  of  output 

a39 

a40 

a41 

355,020 

365,671  (3%  a39  + a39) 
390,522  (10%  a3g  + a^) 

F.  2 Responsiveness  to  Organ  l zat  i ona  l Goals  _ojl_  Do  I)  Admin  l strators 

There  is  tremendous  potential  for  refining  the  sensitivity 
of  the  model  using  the  type  of  constraint  described  in  this  section. 
It  would  require  careful  consideration  of  the  goal  criteria  by  DDC, 
possibly  a restructuring  or  finer  breakdown  of  program  projects  than 
that  shown  in  the  1978  Program/Budget. 


I 


I 

I 

I 

I 

I 

I 


Table  3-1  indicated  a goal  structure  fur  decision  analysis 
that  was  inferred  from  the  goals  survey  of  DoD  administrators.  It 
indicated  that  four  information  service  functions  should  be  provided 
by  !)DC.  Goal  criteria  and  definitions  of  the  relationships  between 
projects  and  organizational  goals  have  been  provided  by  management  in 
the  form  of  desired  percentages  of  the  basic  and  investment  program 
projects  that  should  be  devoted  to  the  four  organizational  goals. 


goal  criteria 


): 


a = Desired  percentage  of  the  basic  program  providing 
^2  access  to  information  as  opposed  to  documents  (182) 


43 


44 


45 


46 


47 


48 


Desired  percentage  of  the  investment  program  devoted 
to  improving  access  to  information  as  opposed  to 
documents  (25%) 

Desired  percentage  of  the  basic  program  providing 
access  to  DDC  held  documents  (522) 

Desired  percentage  of  the  investment  program  devoted 
to  improving  access  to  DDC  held  documents  (252) 

Desired  percentage  of  the  basic  program  providing  remote 
access  to  documents  and  information  (10%) 

Desired  percentage  of  the  investment  program  devoted 
to  improving  remote  access  to  documents  and  infor- 
mation (15%) 

Desired  percentage  of  the  basic  program  promoting  the 
use  of  information  products  and  services  (52) 


Constraints  for  the  model  can  be  expressed  as  follows: 


F. 2. 1 Desired  Proportion  of  the  Program  Concerned  with  Providing 
Access  to  Informal  ion  as  Opposed  to  Documents 


Basic  Program: 


+ 


45 

7T 


i — 3 1 


I 


42iVi 


60 


+ 7T 

1=51 


a 


42 


(17) 


56 


A A 1 


I 


whi'  re : 


Identity  coefficients  which  indicate  management's 
description  of  the  i1*1  project  with  regard  to  its 
fulfilling  organizational  goal  criterion  a^.  Zero 
indicates  it  does  not  serve  this  function,  1 indi- 
cates it  does.  Values  less  than  1 indicate  the 
percentage  of  the  program  contributing  to  goal  a 
(Values  for  I ^ . are  shown  in  Table  3-7). 


S = The  total  service  program: 


I,  ♦ E„ 


t-  X y y 

i=ll  i=31 


Investment  program: 


26 

45 

60 

k i 

i=ll 

43iXi 

+ Tf  I y 

i=31  43iYl 

+ Tf 

i=51 

j+ 

d43  " 

d43 

a43 

where:  S = equation  (18) 


= Identity  coefficients  which  indicate  the  projects 

associated  with  goal  criterion  a,n  (Table  3-7). 

4 J 


T. 2. 2 Des i red  Proportion  of  the  Program  Concerned  with  Providing 
Access  to  Documents 


Basic  Program: 


26 

Tf  lx. 
L < = , , 441  1 


+ 7T  r v . + 

44i  i 


60 

Tf  i z . / s 

44i  i 

1 = 51 


d 44  - d 44 
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TAISI.i:  1-7 


VALUES  01'  I 


42  i 


r 


50  i 


1 421 

I 

441 

‘«1 

46i 

I 

471 

I 

481 

r 

491 

I 

501 

X11 

1 

0 

0 

0 

0 

0 

0 

0 

0 

x12 

1 

0 

0 

0 

0 

0 

0 

0 

0 

X13 

l 

0 

0 

0 

0 

0 

0 

0 

0 

X15 

1 

0 

0 

0 

0 

0 

0 

0 

0 

X16 

1 

0 

0 

0 

0 

0 

0 

0 

0 

X17 

1 

0 

0 

0 

0 

0 

0 

0 

0 

X18 

1 

0 

0 

0 

0 

0 

0 

0 

0 

X19 

1 

0 

1 

0 

0 

0 

0 

1 

0 

X191 

1 

0 

1 

0 

0 

0 

0 

1 

0 

x192 

1 

0 

1 

0 

0 

0 

0 

1 

0 

X21 

0 

0 

1 

0 

. 044* 

0 

0 

0 

1 

x22 

0 

0 

1 

0 

0 

0 

0 

0 

0 

x23 

0 

0 

1 

0 

0 

0 

0 

0 

0 

x24 

0 

0 

1 

0 

0 

0 

0 

0 

0 

X25 

0 

0 

0 

0 

0 

0 

0 

0 

0 

x26 

0 

0 

1 

0 

0 

0 

0 

0 

0 

y31 

0 

1 

0 

1 

0 

0 

0 

0 

0 

y 22 

0 

1 

0 

0 

0 

1 

0 

0 

0 

y33 

0 

1 

0 

0 

0 

0 

0 

0 

0 

y 34 
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1 

0 

1 

0 

0 

0 

0 

0 

y4 1 

.80 

.20 

0 

0 

0 

0 

0 

0 

0 ' 

y42 

0 

0 

.80 

.20 

0 

0 

0 

0 

0 

y43 

.40 

.60 

0 

0 

0 

0 

0 

0 

0 

y44 

.50 

.50 

.50 

.50 

.50 

0 

0 

1 

0 

y45 

0 

1 

0 

1 

0 

0 

0 

0 

0 

Z51 
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0 

0 

0 

0 

0 

0 

0 

0 

Z51 1 

0 

0 

1 

0 

0 

0 

1 

0 

0 

z52 

1 

0 

0 

0 

0 

0 

0 

0 

0 

z53 

0 

0 

0 

0 

0 

0 

0 

0 

0 

7 

60 

0 

0 

0 

0 

0 

0 

0 

0 

0 

D<-s  1 rr'd  1RZ  21X  . 52  .25  -1°  -15  -0^  ' 20 

Percent  ages 


Tills  value  represents  4 of  the  91  staff  positions  in  project 
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win'  re : 


I,..  projects  associated  witli  goal  criterion  a. 

(Table  3-7)  1 

S = equation  (18) 


Investment  Program: 


26  46 

7T  I x + 7T 


+ 77*  i 7 

1=57  431 


5,  / S 

1 


^ A , _ ^ C 3 /,  C 


where:  1^.  = is  indicated  in  Table  3-7  and 


5 = equation  (18) 


F*2-3  Desired  Proportion  of  the  Program  Concerned  with  Providing 
Remote  Access  to  Documents  and  In  f or mat i on 

Basie  Program: 


77*  r x + 7T  j v + JT  , / c 

, 461  i , „ 46i  yi  . _ '46  i 7i  ' S 


d 46  ' d 4b 


wiiere:  *46i  = *s  indicated  in  Table  3-7  and 


equation  (18) 


Investment  Program: 


I'7-X‘  + 

47i  l 


45  60  , 

1 + + /S  -«47 

i-31  i=51  J 


wiiere:  1^.  = is  indicated  in  Table  3-7  and 

S = equation  (18) 
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p.2.  Desirj  I Proportion  ol  thj  Prograi  1 mcerned  with  Promoting 
Inform.it  ion  Prodiu  i . .mil  Services 


Basil  Program: 

-26  4 5 

TV  i x TV  i 

L i 11  131 


. .v  . 

i.,i  i 


60 

+ TV  i 

i = 5 1 


4.M7  L 


/ S 


+ d48  ' d48 


= a48  (24) 


where:  I._.  = is  indicated  in  Table  3-7  and 

48  l 


S = equation  (18) 


F. 3 Pi  ram  Kespons i veness  to  User  Needs 


Two  goal  criteria  were  identified  by  management  for  consideration. 
• goal  criteria  (a^ ) : 


a = Desired  percentage  of  the  program  resources 

devoted  to  projects  that  provide  timely  service, 
(i.e.  24  hour  turn-around).  (207) 

a q = Desired  percentage  of  resources  devoted  to  the 
function  of  conserving  Dot)  RDT&E  Technical 
reports.  (20%) 


1.3.1  T i me  1 i ness  Coal  Criterion 

Using  the  same  approach  as  section  F.2,  the  constraint  can 
be  written: 


r 26 

TV 

L i=  1 1 


'49  i vi 


45  60 

+ TV  l49iyL  + TV  l49iZi 

i=  31  i = 51 


+ 


49 


^9  (25) 


who  re  : 


49  i 
S 


is  indicated  in  Table  3-7  and 
equation  (18) 
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F.  i.  2 


Conse  t vMl  ; on  of_  I)ol)  KDT4F  Teclin  i ca  I Reports 
Continuing,  the  approach  used  in  F.  3.  I : 


26 

45 

60 

* 

n ' .Ci 

+ ^ lb0O'i 

+ 7T  lb0i7.L 

/ F. 

i = 1 1 

i=31 

i = 5 1 

a (26) 

50 


where:  1^. 

S 


is  indicated  in  Table  3-7  and 
equation  (18) 


DF.Y!  LOnrh'T  OF  Till.  OBJECTIVE  FUNCTION 


The  objective  function  specifies  the  priorities  for  minimizing 
thi  positive  (d * ) and  the  negative  (d^)  deviations  from  the  50  goal  cri- 
teri  . (a.).  These  priorities  are  assigned  by  management.  They  specify 
thi-  i;  : : : an  . attached  to  each  of  the  goals  by  DDC. 


First,  the  preemptive  priority  factors  (T^)  must  be  assigned 
to  tin  dcviutional  variables.  Second,  if  necessary,  differential 
weight  an  1)  assigned  to  deviational  variables  at  the  same  priori  tv 
leve  1 . 

Table  1-8  is  the  initial  priority  ordering  as  structured  for 
the  firt  test  run  of  the  model  that  is  described  in  Section  IV. 


CONCLUSION 

The  temptation  is  strong  to  formulate  additional  constraints 
that  express  interesting  relationships  among  the  variables.  Indeed, 
additional  constraints  would  add  to  the  model's  sensitivity.  However, 
it  must  be  considered  that  they  would  also  add  significantly  to 
the  complexity  of  the  model.  On  balance,  a more  complex  model  than 
the  formulation  presented  in  this  report  would  appear  to  be  counter 
productive  until  such  time  as  those  who  will  operate  it  at  DDC  have 
mastered  the  goal  programming  technique  and  can  actively  participate 
in  expanding  the  basic  formulation. 


AAl 


6 1 


TAIU.i:  5-3 


]_n 1 !.AJ . J : v;:  fi inctton  values  i’k * 


Coal  Criteria  (a.) 

Init Lai  rui 

d"  <1 

A.  Total  Staff 

(491) 

P2  o 

a2  (454) 

pi 

B.  Total  Cost 

a3  (0) 

0 P7 

C.  Basic  Services 

a (85") 

a5  (363) 

P5  0 

D.  Investment  Services 

a6  (152) 

P4 

a 1 (68) 

P5  0 

E.  Target  Levels  for 

Individual  Programs 

in  man-years 

a 8 (13) 

P6 

a9  (13) 

P6 

a 

P, 

10  (1) 

6 

ail  (2) 

P6 

a12  (1) 

P6 

P, 

13  (4) 

6 

P 

14  (2) 

6 

3 15  (15) 

P6 

3 16  (2) 

P6 

3 17  (2) 

P6 

a 18  (91) 

P6 

P, 

19  (10) 

6 

P 

20  (62) 

6 

a 

P, 

21  (7) 

6 

a 

p. 

22  (1) 

6 

a 

p. 

23  (23) 

6 

3 24  (0) 

P6 

a 

P, 

25  (3) 

6 

a 

p. 

26  (5) 

6 

a 

p. 

27  (1) 

6 

a 

p. 

28  (5) 

6 

a 

p. 

29  (7) 

6 

a 

p£ 

30  (19) 

6 

a 

p. 

31  (17) 

6 

a 

p. 

32  (25) 

6 

a 

p. 

33  (80) 

6 

a 

p. 

34  (4  ) 

6 

a 

p. 

35  (19) 

6 

a 

p. 

36  (5) 

6 

a 

p. 

37  (15) 

6 

g? 


TABU:  3-8 . TNTTTA1,  OBJECTIVE  FUNCTION  VALUES  P * (cont’d) 


a . 

l 

initial 

r tin’1 

F.  Distribution  by 

d~ 

7+ 

Organizational  Coals 
and  User  Needs 

F.1.1  Managers  vs. 

Scientists  and 
Engineers 

a 38  (1:7) 

P3 

P3 

F.1.2  Libraries  (workload 

a 055,020) 

P, 

- 

39 

8 40  <365’671 

P3 

— 

(390,000 

P3 

0 

F.2  Functional  Coals 

3 42  °8r) 

P3 

P3 

a (2551) 

43 

P3 

P3 

a (52%) 

44 

P3 

P3 

a (25%) 

45 

P3 

P3 

a (10%) 

P3 

P3 

a (157) 

47 

P3 

P3 

a,  (5%) 

48 

P3 

P3 

F. 3 Responsiveness  to 

Users 

8 49  (20%) 

P3 

P3 

8 50  <2°U 

P3 

P3 

is  the  priority  order  assigned  to  indicate  the  importance  of 
minimizing  the  respective  deviations  from  the  goal  criteria,  a . 

0 indicates  an  impractical  solution  not  to  be  considered  in  the 
mode]  whereas  a blank  indicates  the  deviational  variable  is  in  the 
model,  but  not  in  the  objective  function. 
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SECTION  TV.  RESULTS  AND  ANALYSIS 

As  indicated  in  the  Introduction,  the  objective  of  this  study 
has  been  to  present  a pragmatic  goal  programming  model  applicable  to  the 
DDC  decision  environment  and  test  its  application  potential  in  policy 
analysis  with  respect  to  resource  allocation  and  project  evaluation  decision 
making. 

The  model  is  presented  in  the  preceding  Section.  This  section 
presents  the  test  results  and  analysis. 

4.1  TEST  METHOD 

The  application  potential  of  the  goal  programming  model  is 
principally  a question  of  whether  the  model  produces  useful  information 
for  decision-making  by  DDC  managers  and  administrators.  It  is  appro- 
priate, then,  to  test  the  model  by  producing  solutions  to  a decision 
problems,  analyzing  the  results  and,  in  collaboration  with  DDC  management, 
examining  in  what  ways  the  information  produced  by  the  model  is 
actually  useful. 

Three  types  of  information  are  provided  in  goal  programming 
mode]  solutions: 
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(1)  Identification  of  the  optimum  resource  allocation 
scheme.  It  is  optimum  in  the  sense  that  the  given 
solution  enables  the  decision-maker  to  attain  his 
goals  as  nearly  as  possible  within  the  stated  goal 
criteria  and  priority  structure. 

(2)  The  degree  of  goal  attainment  provided  by  a proposed 
program  design. 

(3)  The  relative  degree  of  goal  attainment  provided  by 
alternative  goal  priority  structures. 


The  following  test  runs  demonstrate  the  use  of  this  infor- 
mation for  decision  analysis  of  resource  allocation  and  program 
evaluation  problems  at  DDC. ^ 

In  addition,  because  this  is  a testing  procedure,  the 
discussion  of  the  test  results  is  equally  concerned  with  examining 
the  completeness  and  sensitivity  of  the  model.  These  characteristics 
determine  the  model's  ability  to  reflect  the  real  problem. 

a . 2 i nscuss  roN  format 

The  discussion  format  is  structured  to  demonstrate  the  manner  in 
which  goal  programming  is  used  for  decision  analysis.  Each  run  consists  of 
four  steps: 

(1)  Consideration  of  the  relationship  of  the  run  to  the 
basic  decision  problem.  The  initial  run  establishes  the 
rationale  for  the  overall  approach  to  analyzing  the  problem. 
Subsequent  runs  are  based  on  the  decision-maker's 

review  of  his  priorities  and  judgement  in  view 
of  model  solutions. 

(2)  Definition  of  goal  criteria  and  priorities  for  the  run. 

2 

(3)  Computation  of  the  solution. 

(4)  Analysis  of  the  solution. 


Insofar  as  the  technical  data  and  goal  criteria  are  quantitatively 
accurate,  these  solutions  also  provide  reliable  guidance  for  evaluating 
the  1978  Program/Budget  against  the  stated  administrative  goals.  However, 
such  use  of  these  results  i-s  contingent  upon  careful  review  of  the  input 
data  by  operating  managers.  The  data  used  for  the  study  was  supplied  by 
DDC  primarily  to  test  the  applicability  of  the  goal  programming  methodology. 

The  computer  program  used  to  calculate  problem  solutions  is  described 
in  Appendix  I). 
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RUN  1 


| 

4.3 

The  initial  run  is  directed  toward  examining  the  use  of 
the  goal  programming  model  for  evaluating  an  overall  program  plan 
in  terms  of  organizational  goal  criteria.  DDC's  1978  Program/Budget 
plan  is  used  as  the  test  program. 

4.3.1  Relationship  of  the  First  Run  i ; th<  Dei  i ;ion  P rob lea 
The  goal  criteria  in  the  model  represent  six  concepts: 

A.  Total  staff  constraint 

B.  Total  cost  constraint 

C.  Basic  services  goal 

D.  Investment  services  goal 

E.  Target  levels  for  manning  the  projects  in  the 
proposed  program 

F.  Balanced  distribution  of  labor  resources  according 
to  organizational  and  user  need  goal  criteria 

In  the  first  run  the  model  was  used  to  determine  what 
would  happen  to  the  proposed  program  (item  E)  if  the  goals  to  achieve 
a well  balanced  program  (item  F)  and  the  service  goals  (items  C and 
D)  were  considered  more  important  than  carrying  out  the  proposed 
project  plan  at  the  levels  of  effort  anticipated  in  the  1978  Program/ 
Budge  t . 

In  effect,  this  scheme  evaluates  the  proposed  program  in 
terms  ol  the  goal  criteria.  Only  if  the  proposed  program  were  in 
balance  with  all  other  goals  could  the  solution  match  the  1978  Program/ 
Budget  labor  allocation  plan. 

Specifically,  in  this  run  the  model  treats  all  the  proposed 
projects  as  equivalent  alternatives  by  which  DDC  may  serve  its  organi- 
zational mission.  Using  the  higher  order  goal  criteria  (i.e.  higher 
than  the  priority  given  to  the  administrator's  commitment  to  its 
proposed  program)  as  a basis  for  choosing  among  the  project,  the  model 
tends  to  allocate  resources  to  projects  with  high  scores  on  effectiveness 
(goal  criteria  ar  and  a^)  which  also  contribute  to  the  attainment  of  the 
organizat  ional  goals  (goal  criteria  a ^ to  a^g).  Projects  with  low 
evaluation  ratings  in  the  model  receive  little  or  no  resources. 
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As  a result,  it  is  valid  to  conclude  that  for  the  projects 
receiving  no  resources  in  the  solution,  insufficient  justification 
for  carrying  out  these  projects  has  been  provided, by  management,  in 
the  model. 

For  the  decision-maker  this  means  that  he  must  review  his 
basis  for  setting  the  resource  targets  in  the  program  plan  (Item  E). 

If  sufficient  justification  cannot  be  found  for  those  projects  which  the 
model  has  not  supported,  then  the  unjustified  projects  should  be  discon- 
tinued. The  freed  resources  (i.e.  staff  positions)  should  be  reallocated  to  a 
project  more  in  the  line  with  the  organization's  goals.  However,  it  is 
possible  that  there  are  implied  organizational  goals  represented  in  the 
stated  program  plan,  for  example  maintaining  "staff  stability".  If  so, 
additional  program  justification  (i.e.  "goals")  determined  in  this  manner 
should  be  documented  and  possibly  factored  into  the  basic  model.  At  least, 
it  should  be  noted  in  the  Annual  Program/Budget  justification. 

Of  equal  interest  to  the  decision  maker,  the  goal  programming 
technique  of  decision  analysis  provides  him  with  an  opportunity  to 
I j review  this  judgement  of  the  goal  priorities  in  view  of  the  solution. 

This  will  lead  to  further  runs  to  consider  policy  alternatives  that 
might  produce  a more  satisfactory  degree  of  goal  attainment,  including 

a more  satisfactory  allocation  of  resources  solution.  In  the  process, 

the  decision  maker  will  arrive  at  a clearer  understanding  of  his 

priority  structure  than  he  had  before  using  the  model. 

For  this  study,  a matter  of  special  interest  to  DDC  was 
introduced  into  the  decision  problem  in  order  that  DDC  would  have  a 
meaningful  basis  for  judging  the  model's  usefulness.  In  the  1978 
Program/Budget  it  was  planned  to  commit  4 permanent  staff  positions 
to  manning  remote  computer  data  base  access  centers  at  Boston  and  Los 
Angeles  as  part  of  DDC's  basic  service  program  (represented  by  goal 
criteria  and  a^).  This  represented  a transfer  of  the  effort 
from  a developmental  project  to  a basic  program. 

In  practice,  the  decision-maker  would  want  the  model  to  help 
determine  how  such  new  projects  fit  into  the  overall  program  and  how 
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they  relate  to  the  stated  organizational  goals.  lie  i.s  able  to  do 
so  with  the  use  of  the  model  because  the  quantitative  properties 
that  relate  all  projects  to  the  organizational  goals  have  been 
defined  in  the  basic  moJel.  The  numerical  data  relative  to  the 
new  projects  have  been  supplied  for  this  study  by  DDC  and  are  rep- 
resented in  the  data  tables  of  Section  III  in  association  with 
project  symbols  anc* 

In  the  initial  run,  the  priority  to  commit  adequate  labor 
resources  to  the  new  projects  and  Is  put  at  level  six  (P^) 

along  with  all  other  projects  such  that  all  proposed  projects  would 
be  evaluated  on  an  equal  basis,  subject  to  the  higher  priority  organiza- 
tional and  service  goal  criteria  specified  in  the  input  data  (P^  and  P^) . 

One  other  characteristic  of  the  initial  run  which  should  be  noted 
is  that  the  goal  to  minimize  costs  has  been  placed  at  the  lowest  level. 

This  is  done  to  treat  the  program  evaluation  question  initially  on  the  merits 
of  technical  criteria  only.  When  the  cost  criteron  is  targeted  at  zero  dollars 
and  made  the  lowest  goal  as  it  is  in  this  run,  the  effect  is  that  the  model 
calculates  the  total  projected  cost  of  its  optimal  solution  as  positive 
slack  (d^).  In  other  words,  the  value  of  d^  is  the  cost  of  this  solution. 

Thus,  one  more  useful  item  of  information  for  decision-making  is  supplied. 

A. 3. 2 Goal  Critc  r ia  and  Priorities  for  Run  1 

Table  4-1  illustrates  the  goal  criteria  and  priorities  for 
the  initial  run.  These  data  are  used  to  construct  the  objective  func- 
tion which  specifies  the  importance  attached  to  each  of  the  goals  by 
management  for  the  run. 

The  first  priority  (1*1)  specifies  that  the  total  staff  should 

be  454  as  targeted  in  the  1978  budget  (a^).  The  second  priority  (P.,) 

specifies  that  491  staff  positions  could  be  supported  by  using  outside 

contract  services  to  augment  the  in-house  staff  (a^).  The  goal  of 

priority  three  (P^)  is  that  the  labor  resources  should  be  apportioned 

among  projects  in  a way  that  they  meet  criteria  for  a well  balanced 

program  according  to  organizational  goals  and  user  needs  (a_„  through 

Jo 

a^^).  Priority  four  (P^)  is  the  goal  to  have  a program  which  is  85% 
devoted  to  providing  basic  services  and  at  least  15%  devoted  to  programs 
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TABLE  4-1 


INITIAL  OBJECTIVE  FUNC1 ION  VALUES  P * 


Co.il  Criteria  ( a . ) :'1  * 


A.  Total  Staff 

ax  (491) 
a2  (454) 

Total  Cost 
aj  (0) 

Basic  Services 

a,  (85%) 
a5  (363) 

Investment  Services 
a.  (15%) 


Run  1 


B. 


C. 


‘7 


(68) 


E. 


Target  Levels  for 
Individual  Programs 
in  man-years 


8 

(13) 

9 

(13) 

10 

(1) 

11 

(2) 

12 

(1) 

13 

(4) 

14 

(2) 

15 

(15) 

16 

(2) 

17 

(2) 

18 

(91) 

19 

(10) 

20 

(62) 

21 

(7) 

22 

(1) 

23 

(23) 

24 

(0) 

25 

(3) 

26 

(5) 

27 

(1) 

28 

(5) 

29 

(7) 

30 

(19) 

31 

(17) 

32 

(25) 

33 

(80) 

34 

<*  ) 

35 

(19) 

36 

(5) 

37 

(15) 
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** 

a 

42 

08?.) 

a 

43 

(252) 

a 

(522) 

44 

a 

45 

(252) 

a 

46 

(102) 

a 

47 

( 152) 

a 

4b 

(52) 

F.  3 

Respons i veness  to 

Users 

a 

49 

(202) 

a 

50 

(202) 

considered  to  be  "investments"  for  developing  future  capabilities 
(a4  and  afe). 

Priority  five  (Ptj)  is  the  goal  to  distribute  the  available 
labor  resources  to  projects  according  to  their  relative  effectiveness 
(a,,  and  a-,).  The  goal  of  priority  six  (P^)  is  to  provide  the 
specified  labor  resources  shown  in  the  1978  Program/Budget.  Priority 
seven  (P^)  is  the  cost  goal  which  is  set  at  zero  to  minimize  costs  and 
calculate  the  projected  cost  of  the  opitmum  solution. 


4.3.3  Solution  (Run  1) 

The  optimum  solution  calculated  for  the  first  run  is  provided 
in  Tables  4-2,  4-3,  and  4-4.  For  demonstration  purposes,  the  tables 
illustrate  the  computer  print  outs. 

The  slack  analysis  (Table  4-2)  indicates  how  close  the  optimum  sol- 
ution comes  to  meeting  the  50  specified  goal  criteria  in  the  model.  Positive 
slack  (POS-SLK)  indicates  by  how  much  the  solution  exceeded  a criterion 
and  negative  slack  (NEG-SLK)  indicates  by  how  much  the  solution  failed 
to  meet  a criterion.  The  row  numbers  (a.)  i .rrespond  to  the  goal 
criteria  numbers  of  the  basic  model  described  in  Section  III. 

The  variable  analysis  (Table  4-3)  designates  the  labor  resources 
the  model  has  allocated  to  the  proposed  projects. 

The  analysis  of  the  objective  (Table  4-4)  indicates  the  degree 
of  goal  attainment  represented  in  the  solution. 


4.3.4  Analysis  of  the  So lut ion  (Run  I ) 

The  optimum  solution  indicates  in  Table  4-3  that  only  12  of 
the  thirty  projects  should  receive  labor  resources  if  the  goal  struc- 
ture and  the  mode]  inputs  are  accurate.  It  should  be  noted  that 
projects  X and  to  support  the  remote  access  computer  terminals 

are  not  among  the  projects  in  the  solution.  However,  this  solution 
is  the  "best"  possible  to  attain  the  goals  as  closely  as  possible 
within  the  stated  criteria. 

With  respect  to  the  projects  X^j  and  X ^ ^ ^ it  would  appear 
that  based  on  the  criteria  provided  in  the  model  that  there  are  more 
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Project 

Codes 


TABLE  4-2. SLA( ' K A NA I .Y SIS  (RUN  1 ) 


ROW 

(aj. ) 

AVAILABLE 

POS-SLK 

NEG-SLK 

1 

491 

0 

37 

2 

454 

0 

0 

3 

0 

9268 

0 

4 

0 

0 

75 

5 

363 

0 

278 

6 

0 

75 

0 

7 

68 

0 

46 

11  8 

13 

0 

13 

12  9 

13 

4 

0 

13  10 

1 

6 

0 

15  11 

2 

0 

2 

16  12 

1 

0 

1 

17  13 

4 

0 

4 

18  14 

2 

0 

2 

19  15 

15 

0 

15 

191  16 

2 

0 

2 

192  17 

2 

0 

2 

21  18 

91 

0 

31 

22  19 

10 

0 

10 

23  20 

62 

4 

0 

24  21 

7 

0 

7 

25  22 

1 

0 

1 

26  23 

23 

0 

23 

31  24 

0 

0 

0 

32  25 

3 

42 

0 

33  26 

5 

, 0 

5 

34  27 

1 

0 

1 

41  28 

5 

0 

5 

42  29 

7 

0 

7 

43  30 

19 

0 

19 

44  31 

17 

43 

0 

45  32 

25 

20 

0 

51  33 

80 

49 

0 

511  34 

4 

0 

0 

52  35 

19 

0 

19 

53  36 

5 

0 

0 

60  37 

15 

0 

0 

38 

0 

0 

0 

39 

355020 

35504 

0 

40 

365671 

24851 

0 

41 

390522 

0 

0 

42 

0 

0 

0 

43 

0 

45 

0 

44 

0 

0 

0 

45 

0 

0 

0 

46 

0 

0 

0 

47 

0 

0 

0 

48 

0 

0 

11 

49 

0 

0 

0 

50 

0 

0 

0 
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TABLE  4-3.  VARIABLE  ANALYSIS  (RUN  1) 


Symbol 

Name 

Variable  No. 

Amoi 

X23 

Tech  Report  Request  Distr 

13 

67 

X19 

RDT&E  On-Line  Terminal 

8 

1 

X32 

Integrated  R&D  Info  Sys 

18 

46 

X45 

DDC  Sys  Redesign  and  Imple 

25 

46 

X51 

Management  and  Admin 

26 

130 

X311 

4 People  for  Promotion  & Markg 

27 

4 

X53 

STINFO  Central  Registry 

29 

5 

X60 

Support  of  Non-DDC  Act 

30 

15 

X12 

R&T  WUDB  Output 

2 

17 

X13 

STINFO  S/R  Data  Bank 

3 

8 

RDT&E  On-Line  System 

24 

61 

X21 

Technical  Report  Input 

11 

61 
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TABI.K  4-4.  ANALYSTS  OF  THE  OBJECT I VI-  (RUN  1) 


PRIORITY 

7 

6 

5 

4 

3 

2 

1 

ARTIFICIAL 


UNDER- ACM  I EVi'.MENT 


9278 

169 

324 

75 

59 

37 

0 

0 
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important  priorities  to  serve  before  any  further  expansion  of  the 
on-line  system  is  undertaken. 

This  solution  provides  interesting  information  about  the 
model  because  it  identifies  the  projects  that  are  clearly  related 
to  the  organizational  goals.  However,  the  distribution  of  resources 
it  calls  for  may  be  impossible  to  achieve  in  reality.  In  fact, 
upon  consideration  of  this  solution,  the  decision-maker  col 1 abora t i ng 
on  the  evaluation  determined  that  regardless  of  whether  the  stated 
criteria  were  valid,  such  a solution  would  not  be  feasible  and 
even  at  the  expense  of  organizational  goals  a more  satisfactory 
outcome  had  to  be  sought. 

Other  information  provided  by  the  solution  indicates  that  for 

the  seven  goal  priorities  only  the  first  goal  was  fully  attained  (i.e. 

use  454  man-years),  and  the  cost  (priority  seven)  is  approximately 
a 

$9,268,000.  The  cost  exceeds  the  projected  labor  budget  in  the  1978 
Program/Budget  (i.e.  $8,778,000)  by  5.58%. 

The  excess  cost  of  5.38%  was  of  some  concern  but  not  enough 
to  make  cost  a higher  priority  constraint.  On  the  other  hand,  the 
low  degree  of  goal  attainment  raises  significant  questions  about  the 
consistency  of  the  goal  structure  and  criteria  expressed  in  the  model. 

For  example,  it  was  not  possible  to  fully  achieve  the  balanced 
program  goal  specified  as  priority  three.  This  was  a result  of 
inconsistency  among  the  criteria  within  the  third  priority  as  no 
conflict  with  a higher  goal  was  indicated  in  the  solution.  In  addition, 
in  order  to  maximize  the  degree  of  achievement  represented  in  the 
third  priority  it  was  necessary  for  the  model  to  allocate  more  than 
15%  of  the  total  resources  to  investment  programs.  This  can  be  seen 
in  Tab^e  4-2  with  respect  to  rows  a^  and  a^  where  the  basic  program 
goal  (85 7)  is  underachieved  by  approximately  75  units,  and  the  invest- 
ment program  goal  (15%)  is  overachieved  by  approximately  75  units.  This 
uncli cates  simply  that  the  goal  criteria  to  distribute  the  labor  resources 
according  to  organizational  goals,  including  u.  or  needs  and  specified 

See  Table  4-4.  it  should  be  noted  that  the  algorithm  used  to  compute  a 
solution  may  assign  an  "artificial"  priority  to  the  goal  structure  in 
order  to  obtain  a first  iteration  solution  basis  but  this  does  not 
change  the  net  outcome  of  the  model. 
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functions  (a  through  ar,)  call  for  more  titan  IV  of  the  total  program 
5o 

in  the  investment  aspects. 

These  results  suggest  a number  of  questions  for  the  analyst 
and  decision-maker  to  consider.  Are  the  goal  criteria,  especially 
the  organizational  goals  (a through  a^)  and  service  goals  (a^  and 
a6)  reasonable?  If  r -,  have  the  properties  of  the  proposed  projects  been 
accurately  characterized  in  relationship  to  these  goals.  Re-examin- 
ation of  the  data  applicable  to  projects  X ^ ^ and  X^.,,  for  instance 
indicates  that  they  are  characterized  as  "basic"  projects.  The  model 
solution  indicates  that  the  program  is  deficient  in  its  investment 
aspects.  Perhaps  projects  X ^ c) ^ and  X^,>  are  representative  of  the 
tvpe  of  effort  DDC  intends  to  pursue  as  investment  projects.  Certainlv, 
they  represent  a significant  improvement  in  DDC's  manner  of  providing 
information  services.  If  so,  they  should  be  re-coded  as  investment 
projects,  in  which  case  it  is  more  likely  the  model  would  allocate 
resources  to  them. 

..  3.  r>  Imp!  icat  inns  of  the  Results 

The  main  result  of  the  initial  run  is  to  underscore  the 
complexity  of  DDC's  decision  environment.  The  operating  program  is 
forced  to  respond  to  multiple,  competing  criteria.  Taken  alone,  each 
of  the  stated  goal  criteria  appears  reasonable.  Together  they  are  incon- 
sistent and  in  conflict.  The  model  helps  identify  where  the  conflicts  exist. 

The  guides  for  decision  making  suggest  that  more  planning 
emphasis  should  be  placed  on  investment  projects,  particularly  invest- 
ment projects  to  improve  access  to  information;  and,  that  appropriate 
goals  must  be  stated  to  justify  the  projects  that  were  not  represented 
in  this  solution, if  they  are  not  to  be  discontinued, 

4 . 4 RUN  2 

Cmphasis  in  the  second  run  is  placed  on  examining  the  use  of 
the  model  to  determine  the  degree  of  goal  attainment  provided  by  a 
specified  program  of  projects. 
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4.4.1  lie  ] .it  ioiv  li  iji  of  iIk  Sim  oihI  Nun  in  tin-  I H m i s inn  Problem 

It  was  evident  from  the  results  of  the  first  run  that  the 
1978  Program/Budget  does  not  conform  to  the  organizational  goals. 

Nevertheless,  there  appears  to  he  a certain  degree  of  validity  to 
both  the  program's  labor  allocation  target  tnd  th<  rganizatioi 
goal  criteria. 

For  the  second  run  it  was  assumed  that  the  organizational 
and  user  need  goal  criteria  (agg  through  a^g)  and  the  service  goals 
(a^  through  a represent  evaluation  criteria  which  DDC's  administrative 
and  user  const ituences  might  consider  desirable  characteristics  of  DDC's 
information  services.  The  program  targe  t levels  (ag  through  ag7) 
represent  the  results  of  DDC’s  consideration  of  all  the  practical 
constraints  and  limitations  of  developing  an  operational  program  of 
products  and  services. 

Furthermore,  the  administrator  determined  that  certain  pro- 
jects were  essential  to  DDC's  operation,  even  if  they  could  not  be 
clearly  related  to  the  organizational  goal  structure.  These  projects 
were  designated  higher  priority  items  for  Run  2 than  the  organizational 
goal  priorities. 

Using  this  strategy  of  formulating  the  problem,  the  decision- 
maker can  analyze  the  effect  of  the  specified  program  on  the  organizational 
goals.  Moreover,  the  model  will  identify  the  goal  areas  in  which  the  program 
is  deficient  and  those  in  which  it  is  strong.  Such  information,  particularly 
where  the  program  is  deficient  in  relation  to  the  goals,  is  useful  for  plan- 
ning new  projects  for  subsequent  budget  years.  This  aspect  is  also  u 
for  discussing  the  nature  of  the  information  program  with  users  for  dis- 
cussing the  nature  of  the  information  program  with  users  and  administrative 
constraints  interested  in  the  DDC  program. 

4.4.2  Goal  Cri  teria  and  i’r  i • ■ r i i i ■ • , I u r Run  2 

Table  4-5  illustrates  the  goal  criteria  and  priorities  for 
run  2 in  comparison  with  run  1.  The  criteria  (;tj)  are  unchanged  t rom 
the  initial  run.  However,  the  priority  structure  is  different. 
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tabu:  4-5.  run  2 on.ir.cTivi:  function  vaut.s  i>  * 


( •<  .1  1 ' 

Run  1 

d~ 

( 

d+ 

A. 

Total 

Staff 

ax  (491) 

P-> 

0 

a2  (454) 

Pi 

P1 

B. 

Tota  1 

Cost 

a3  (0) 

0 

p7 

C. 

Basic 

Services 

a,  (85X) 

p4 

- 

a5  (363) 

P5 

0 

D. 

Investment  Services 

a,,  (157.) 

P4 

- 

a i (68) 

P5 

0 

E. 

Target 

Levels  for 

Individual  Programs 
in  man-vears 

P, 

a 8 

(13) 

6 

a9 

(13) 

P6 

— 

P, 

- 

10 

(1) 

6 

P, 

— 

11 

(2) 

6 

a 12 

(1) 

P6 

- 

a 

n 

Pt 

- 

(4) 

6 

p^ 

- 

14 

(2) 

6 

P, 

- 

15 

(15) 

6 

a 16 

(2) 

P6 

~ 

3 17 

(2) 

P6 

** 

a 18 

(91) 

P6 

- 

P, 

- 

19 

(10) 

6 

3 20 

(62) 

P6 

~ 

P. 

— 

21 

(7) 

6 

p. 

— 

22 

(1) 

6 

' 

a 

23 

(23) 

P, 

0 

■ 

“24 

(0) 

P6 

- 

a 

P, 

- 

25 

(3) 

a 

26 

(5) 

P6 

a 

P, 

— 

27 

(1) 

a 

P, 

- 

28 

(5) 

6 

a 

pfi 

~ 

29 

(7) 

a 

p. 

- 

30 

(19) 

a 

pf, 

“ 

31 

(17) 

a 

p, 

- 

32 

(25) 

a 

33 

(80) 

P6 

a 

IN 

“ 

34 

(4) 

a 

33 

(19) 

P6 

a 

36 

(5) 

P6 

a 

ph 

“ 

37 

(15) 

/8 
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TABL1  , . RUN  2 OBJECTIVE  FUNCTION  VALUES  P * (rout'd) 


aj 

Run  1 

Run 

2 

a’ 

d+ 

d" 

d+ 

F. 

Distribution  by 
Organizat  ion.il  Goals 
a ’.  User  Needs 

F.  I 

1 Managers  vs. 

Scientists  and 
Engineers 

a 38  (1:7) 

P3 

P3 

P5 

P5 

F.  1 

2 Libraries  (workload 

a (355,020) 

P, 

_ 

P, 

_ 

39 

3 

5 

\0  (365'67l) 

P3 

— 

P5 

- 

a4]  (390,000) 

P3 

0 

0 

F.  2 

Functional  Coals 

a 0870 

P, 

P, 

Pc 

42 

3 

3 

5 

5 

a (252) 

43 

P3 

P3 

P5 

P5 

a (522) 

44 

P3 

P3 

P5 

P5 

a (252) 

45 

P3 

P3 

P5 

P5 

a (10/.) 

P3 

P3 

P5 

P5 

a (13) 

P, 

P, 

I> 

Pr 

47 

3 

3 

5 

5 

a (52) 

p. 

p. 

P 

Pr 

48 

3 

3 

5 

5 

F.  3 

Responsiveness  to 
Users 

a49  (202) 
3 50  (202) 

P3 

P3 

P3 

P3 

1 

P 

4 

P4 

P 

4 

P4 

P Is  the  priority  order  assigned  to  indicate  the  importance  of  minimizing 


tfc 


le  respective  deviations  from  the  goal  criteria, 
prior i ty . 


P^  is  the  highest 


0 indicates  an  impractical  solution  not  to  be  considered  in  the  model 
whereas  a blank  indicates  the  deviational  variable  is  in  the  model,  but  not 
in  the  objective  function. 


The  numerial  values  for  a.  are  explained  in  Section  III  with  the  description 
of  tlu'  basic  model. 
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The  constraint  on  the  total  staff  has  been  modified  to 
allow  more  flexibility  in  the  solution.  Priority  one  (P^)  sets  a 
goal  of  at  least  454  man-years  in  the  solution.  Priority  two  (f^ 
sets  the  limit  at  491.  The  goal  not  to  exceed  454  (d+)  has  been 
deleted.  Priority  three  (P^)  now  states  that  the  projects  deemed 
essential  to  DDC's  operation  should  be  allocated  resources  as 
indicated.  Among  the  essential  projects  the  administrator  indicated 
that  project  Y^  (the  DDC  System  Redesign  and  Implementation  Effort) 
is  twice  as  important  as  the  others.  Thus,  the  weighted  priority 
(2  P ) is  indicated  in  the  table.  Priority  four  (P^)  specifies  a 
basic  services  goal  of  85%  of  the  total  program,  and  attainment  of 
goal  criteria  F.3,  Responsiveness  to  Users  (a^g  and  a^).  Priority 
five  (P^)  specifies  the  goal  to  have  15%  of  total  program  devoted 
to  investment  projects  and  to  meet  the  other  organizational  goals 
(a^g  through  a^g).  The  sixth  priority  (Pg)  is  to  apportion  the 
resources  among  the  projects  according  to  their  relative  effectiveness. 
Priority  seven  (P^)  sets  target  levels  for  the  non-essential  projects. 
Priority  eight  (Pg)  is  the  cost  minimization  goal  which  is  again  left 
at  the  lowest  priority  and  set  to  zero  in  order  to  calculate  the 
cost  of  the  optimal  solution. 

4.4.3  Solution  (Run  2) 

The  solution  calculated  for  the  second  run  is  illustrated 
in  Tables  4-6,  4-7  and  4-8.  The  format  is  the  same  as  Run  1. 

4.4.4  Analysis  of  the  Solution  (Run  2) 

The  output  now  indicates  that  27  of  the  30  projects  are 
represented  in  the  solution  (Table  4-7).  Only  projects  Y^.,  (Integrated 
R&D  Information  System),  Y ^ (General  Systems)  and  7.^  (Technical 
Terminology)  are  without  sufficient  justification  in  the  model  to 
receive  resources. 

The  degree  of  goal  attainment  is  much  improved  over  the 
first  run.  Table  4-8  indicates  that  the  four  top  priorities  are 
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TABLE  4-6.  SLACK  ANALYSTS  (RUN  2) 


ROW 

AVAILABLE 

POS-SLK 

NEG- 

(aj.  ) 

1 

491 

0 

0 

2 

454 

37 

0 

3 

0 

9369 

0 

4 

0 

0 

0 

5 

363 

0 

220 

6 

0 

2 

0 

/ 7 

68 

0 

55 

11  8 

13 

0 

0 

12  9 

13 

0 

0 

13  10 

1 

0 

0 

15  11 

2 

0 

0 

16  12 

1 

0 

0 

17  13 

4 

0 

0 

18  14 

2 

0 

0 

19  15 

15 

44 

0 

191  16 

2 

0 

0 

192  17 

2 

0 

0 

21  18 

91 

0 

0 

22  19 

10 

0 

0 

1 r , i ect 

23  20 

62 

5 

o 

des  ( 

24  21 

7 

0 

0 

25  22 

1 

0 

0 

26  23 

23  ' 

58 

0 

31  24 

0 

12 

0 

32  25 

3 

0 

3 

33  26 

5 

0 

0 

34  27 

1 

0 

1 

41  28 

5 

0 

0 

42  29 

7 

0 

0 

4 3 30 

19 

0 

0 

44  31 

17 

11 

0 

45  32 

25 

0 

0 

51  33 

80 

0 

68 

511  34 

4 

0 

0 

52  35 

19 

0 

19 

53  36 

5 

0 

0 

60  37 

15 

0 

0 

V 38 

0 

0 

0 

39 

355020 

35502 

0 

40 

365671 

24851 

0 

41 

390522 

0 

0 

42 

0 

43 

0 

43 

0 

0 

46 

44 

0 

102 

0 

45 

0 

0 

62 

46 

0 

0 

28 

47 

0 

0 

69 

48 

0 

0 

19 

49 

0 

0 

0 

50 

0 

0 

0 

AVI 
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TABU-  4-7.  VARIABLE  ANALYSIS  (RUN 

_2)_ 

Symbol 

Name  Variab 

ile  No. 

Amount 

Z51 

Management  and  Administration 

26 

12.00052 

Y45 

DDC  Sys  Redesign  and  Imple 

25 

24.99998 

X11 

R&T  WUDB  Input 

1 

13.00000 

X,  „ 

R&T  WUDB  Outpvit 

2 

13.00000 

12 

X13 

STINFO  S/R  Data  Bank 

3 

1.00000 

X15 

R&D  Prog  Plang  DB  Input 

4 

2.00000 

X16 

R&D  Prog  Plang  DB  Output 

5 

1.00000 

X17 

Indep  R&D  Data  Bank  Input 

6 

4.00000 

X18 

Indep  R&D  Data  Bank  Output 

7 

2.00000 

X19 

RDT&E  On-Line  Terminal 

8 

59.00037 

X191 

RDT&E  On-Line  Terminal  at  Boston 

, 9 

2.00000 

y 

192 

RDT&S  On-Line  Terminal  at  L.A. 

10 

2.00000 

X22 

Tech  Report  Announcement 

12 

10.00000 

X24 

Tech  Rpt  Automatic  Distr 

14 

7.00000 

X25 

Tech  Rpt  Primary  Distr 

15 

1.00000 

X26 

Tech  Rpt  Bibliographies 

16 

80.09311 

X31 

Advanced  Distr  Systems 

17 

11.74989 

X33 

Natural  Language  Systems 

19 

5.00000 

X41 

RDT&E  Information  Services 

21 

5.00000 

Y42 

Technical  Report  Systems 

22 

7.00000 

Y43 

Integrated  Systems 

23 

19.00000 

Y44 

RDT&E  On-Line  System 

24 

27.99962 

Z5.1.1 

4 People  for  Promotion  & Markg 

27 

4.00000 

Z5.3 

STINFO  Central  Registry 

29 

5.00000 

Z6.0 

Support  of  Non-DDC  Act 

30 

15.00000 

X2.3 

Tech  Report  Request  Distr 

13 

66.15651 

X2.1 

Tech  Report  Input 

11 

91.00000 
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TABLE  4-8.  ANALYSIS  OF  THE  OBJECTIVE  (RUN  2) 


PRIORITY 

8 

7 

6 

5 

4 

3 

2 

1 

ARTIFICIAL 


UNDER-ACH I KVEMENT 

9369 

90 

275 

367 

0 

0 

0 

0 

0 
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4 

fully  achieved  (P^  to  P^).  The  solution  calls  for  49]  man-years 
of  effort  and  the  staff  goal  permitted  a range  from  454  to  491 
(Pj  and  P^)-  Priority  three  (P^)  specified  that  the  essential  projects 
should  receive  at  least  the  man  power  provided  in  the  Program/Budget, 
which  was  achieved.  Priority  four  (P^)  designated  that  85%  of  the 
program  should  be  "basic"  services,  and  also  that  the  user  need  goals 
be  met.  The  solution  meets  these  criteria. 

A key  feature  governing  the  solution  appears  to  be  the  goal 
criteria  that  85%  of  the  program  be  devoted  to  basic  services.  This 
is  indicated  by  the  underachievement  of  priority  five  (P,.).  According 
to  the  model,  any  solution  which  would  improve  P,.  (the  organizational 
goals)  would  adversely  affect  P^.  The  same  condition  is  true  of 
priorities  six  and  seven. 

Priority  eight  is  the  cost  minimization  goal  which  indicates 
a labor  cost  of  approximately  $9,369,000.  This  represents  a slight 
deterioration  from  the  first  solution  as  it  is  6.73%  over  the  1978 
Program/Budget  (i.e.  $8,778,000)  compared  to  a 5.58%  increase  in  the 
first  run. 

With  respect  to  the  50  goal  criteria.  Table  4-6  provides 
more  detailed  information  of  value  to  the  decision-maker. 

The  fact  that  the  model  calls  for  491  man-years  of  effort 
suggests  that  additional  staff  (from  contract  services,  if  necessary) 
ought  to  be  considered  for  the  1978  Program/Budget  in  order  to  maximize 
the  overall  degree  of  goal  attainment.  It  appears  that  so  long  as  there 
are  technical  deficiencies  in  the  proposed  program,  the  model  will 
utilize  all  available  resources  in  an  attempt  to  minimize  them. 

The  Slack  Analysis  (Table  4-6)  identifies  the  investment 

aspect  of  the  program  as  the  most  deficient  area  in  this  solution 

and  the  area  likely  to  benefit  if  additional  staff  were  available. 

Specifically,  for  goal  criteria  a,„  through  a,_  where  the  even  num- 

4z  4 / 

bers  indicate  goals  related  to  the  basic  program  and  the  odd  numbers 


As  noted  previously,  the  artificial  priority  does  not  change  the 
net  outcome  of  the  modi' 1 . 


AAI 
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indicate  goals  related  to  the  investment  program,  the  solution  demon- 
strates a severe  imbalance  with  respect  to  the  investment  goals.  This 
is  shown  by  the  negative  slack  values  for  all  the  odd  numbered  investment  goals. 

Similarly,  the  model's  resource  allocation  to  projects  Y^ 
through  Y.^  (a^,  - indicate  a poor  relationship  between  the 

proposed  development  projects  in  the  1978  Program/Budget  and  the  stated 
organizational  goals.  Of  the  projects  set  at  priority  seven  (P^), 

(Integrated  R&D  Information  System)  and  Y^  (General  Systems)  were 
completely  unachieved.  Project  Y^  (Advanced  Distribution  Systems) 
was  allocated  11  man-years  even  though  the  target  level  for  1978  is 
zero.  This  indicates  that  purposes  served  by  are  more  closely 

related  to  the  organizational  goals  than  the  other  development  projects 
planned  for  1978. 

The  solution  values  for  the  RDT&E  on-line  project  (X^y,  X-^y^  and 
^192^  includes  the  remote  access  terminals  at  Boston  and  Los 

Angeles  provide  an  interesting  comparison  with  the  first  run  solution. 

With  the  revised  priorities,  the  target  level  for  the  Boston  and  Los 
Angeles  facilities  are  now  supported.  In  addition,  the  solution  calls 
for  increased  support  of  the  RDT&E  on-line  effort  by  nearly  300%, 
whereas  in  Run  1 it  was  virtually  unsupported.  This  result  can  be 
accounted  for  by  the  fact  that  in  Run  2 the  goal  of  an  85%  basic 
program  was  a higher  priority  than  the  organizational  goals.  This 
indicates  that  the  RDT&E  on-line  project  is  particularly  sensitive  to  the 
desired  ratio  of  basic  services  to  investment  services  but  not  to 
the  organizational  goals. 

A second  project  that  appears  to  be  sensitive  to  the  85% 
basic  program  criteria  is  X^,  Technical  Report  Bibliographies,  G^^)- 
The  model  calls  for  more  than  doubling  this  project. 

The  slack  analysis  brings  out  additional  points  of  interest 
witli  respect  to  the  accuracy  of  the  model.  Project  Y^  (a»j) 
provided  11  additional  man-years.  Y^  is  the  systems  support  effort 
for  the  RDT&E  on-line  system.  This  response  is  consistent  with  the 
model's  heavy  support  of  the  on-line  service  in  project  X^g. 
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In  another  respect  the  model's  completeness  is  questionable. 
Projects  Z<^  and  Z<p  which  represent  the  administrative  support  effort  are 
significantly  underachieved.  Assuming  that  the  administration  must 
be  proportionate  to  the  technical  staff,  a constraint  may  be  needed 
to  specify  a desired  ratio  of  administrative  staff  to  total  staff. 

4.4.5  Implications  of  the  Results 

The  investment  resources  represent  the  agency's  ability 
to  remain  current  with  the  technology  of  information  processing. 
Consequently,  if  the  imbalance  between  basic  and  investment  efforts 
seen  in  the  1978  Program/Budget  plan  were  to  be  maintained  over  a period 
of  several  years,  the  agency  is  likely  to  fall  behind  in  its  tech- 
nological capability. 

4.5  RUN  3 

The  third  run  is  directed  toward  demonstrating  the  use  of  the 
model  to  consider  the  effect  of  changing  a single  parameter  in  the 
decision-maker's  priority  structure. 


4 5.1  Relationship  of  the  Third  Run  to  the  Decision  Problem 

In  the  first  two  runs  the  estimated  costs  of  the  solutions 
exceeded  the  budget  planned  for  the  1978  Program/Budget.  Therefore, 
it  was  decided  to  assess  the  effect  on  the  degree  of  goal  attainment 
that  would  result  from  increasing  the  priority  of  the  cost  constraint 

4.5.2  Goal  Criteria  and  Priorities  for  Run 3 

Table  4-9  illustrates  the  goal  criteria  and  priorities  for 

run  3. 


In  this  run  the  criterion  for  a^  is  changed  from  zero  to  the 
projected  labor  cost  in  the  1978  Program/Budget,  $8,778,000.  All 
other  criteria  (a^ ) remain  unchanged. 


The  priority  structure  is  also  changed  to  increase  the 
significance  of  the  cost  constraint.  The  goal  for  a staff  between 
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TABLE  i-9.  RUM  i OBJECTIVE  FUNCTION  VALUES  F * 


Coal  Criteria  (■».) 


A Total  Staff 

ax  (491) 
a2  (454) 

B.  Total  Cost 

a 3 (0) 

C.  Basic  Services 

a,  (85%) 
a5  (363) 

D.  Investment  Services 

a6  °5*> 
a7  (68) 


E. 


Target  Levels  for 
Individual  Programs 
in  man-years 


8 

(13) 

0 

(13) 

10 

(1) 

11 

(2) 

12 

(1) 

13 

(4) 

14 

(2) 

15 

(15) 

16 

(2) 

17 

(2) 

18 

(91) 

19 

(10) 

20 

(62) 

21 

(7) 

22 

(1) 

23 

(23) 

24 

(0) 

25 

(3) 

26 

(5) 

27 

(1) 

28 

(5) 

29 

(7) 

30 

(19) 

31 

(17) 

32 

(25) 

33 

(80) 

34 

(4) 

35 

(19) 

36 

(5) 

37 

(15) 

| Run  1 

Hun  2 

Run  3 

d_  , d+ 

d~  d+ 

d“  d+ 

P2  0 

P2 

P2 

P1  P1 

P1 

P1 

a 3 - 8,778 

0 P7 

0 P8 

P3 

P5  0 

P4  P4 

P6  0 

P5  P5 

P7  0 

P4 

5 5 

P6  P6 

P5  0 

P6  0 

•> 

P7  0 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P3  - 

P4 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P3  * 

P4 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P3  - 

P4 

P6 

P3 

P, 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P3 

P4 

P6 

P7  * 

P8  * 

F6 

P7  * 

PB  * 

P6 

P3  - 

P4  - 

P6 

P7  ' 

P8  * 

P6 

P3  - 

P4 

P6 

P3  - 

P4  - 

P6 

P3  * 

P4  * 

P6 

P3  - 

P4  * 

P6 

2P3  * 

2P4  * 

P6 

P7  - 

P8  - 

P6 

P3  0 

P4  ° 

P6 

P7  - 

P8 

P6 

P7  ° 

P8  0 

P6 

P7  0 

P8  ° 

AAI 
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TABL1-:  4-9. Rim  1 OBJECTIVE  FUNCTION  VALUES  P]c* 


Goal  criteria  a.** 
J 

Run 

1 

Run 

2 

Run 

3 

d" 

d+ 

d~ 

d+ 

d~ 

d+ 

F.  Distribution  by 

Organizational  Co^ls 
and  User  Needs 

F.1.1  Managers  vs. 

Scientists  and 
Engineers 

3 38  <1:7) 

P3 

P3 

P5 

P5 

P6 

P6 

F.1.2  Libraries  (workload 

a39  (355,020) 

P3 

- 

P5 

- 

P6 

1 

a40  (365,671) 

P3 

P5 

- 

P6 

' 

a41  (390,000) 

P3 

0 

P5 

0 

P6 

F.2  Functional  Goals 

•«  (18?:) 

P3 

P3 

Pr 

J 

P5 

P6 

P6 

a (257.) 

43 

P3 

P3 

P5 

P5 

P6 

P6 

a (52%) 

44 

P3 

P3 

P5 

P5 

P6 

P6 

a (252) 

45 

P3 

P3 

P5 

P5 

P6 

P6 

a (102.) 

46 

P3 

P3 

P5 

P5 

P6 

P6 

a (157) 

47 

P3 

P3 

P5 

P5 

?6 

P6 

a (52) 

pi 

P, 

P 

Pr 

P 

48 

3 

3 

5 

5 

6 

‘6 

F.  3 Responstvenuss  to 

Users 

3 49  (202) 

P3 

P3 

P4 

P 

4 

P5 

P5 

8 50  (20%) 

P3 

P3 

P4 

P4 

p5 

P5 

** 


P is  the  priority  order  assigned  to  indicate  the  importance  of 
minimizing  the  respective  deviations  from  the  goal  criteria,  a^  . 

0 indicates  an  impractical  solution  not  to  be  considered  in  the  model 
whereas  a blank  indicates  the  deviational  variable  is  in  the  model, 
but  not  in  the  objective  function. 

The  numerical  values  for  a.  are  explained  in  Section  III  with  the 
description  of  the  basic  mtidel. 
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454  and  491  man-years  remains  at  the  first  and  second  priority  levels 
(P^  and  P^).  However,  the  cost  constraint  is  introduced  as  priority 
three  (P^).  All  the  remaining  priorities  are  down-graded  by  one 
priority  level  from  run  2. 

In  effect,  the  problem  is  essentially  the  same  as  run  2, 
except  than  the  solution  must  also  contend  with  the  specific  cost 
target . 

The  structure  of  run  3 is  as  follows: 

• Total  staff  from  454  to  491  man-years 

• Avoid  budget  deficit 

• Sufficient  staff  for  essential  projects 

• 85%  basic  services,  responsiveness  to  user  needs 

• Meet  investment  service  goal  and  organizational 
goal  criteria 

• Distribution  of  resources  according  to 
effectiveness 

• Provide  staff  for  the  remainder  of  the  1978 
Program/ Budget 

4.5.3  Solution  (Run _3) 

The  solution  calculated  for  the  third  run  is  illustrated 
in  Tables  4-10,  4-11,  and  4-12. 

4.5.4  Analysis  of  the  Solution  (Run  3) 

With  the  cost  constraint  introduced  as  a high  priority 
decision  factor,  the  model  was  forced  to  evaluate  the  cost/benefit 
ratio  existing  between  the  projects  and  the  organizational  goals. 

In  this  solution,  the  degree  of  goal  achievement,  as 
indicated  by  Table  4-12  is  improved  to  five  goals  achieved  because 
the  cost  goal  is  now  met.  Whereas,  four  goals  were  achieved  in  the 
previous  run.  The  improved  degree  of  goal  attainment  has  been  achieved 
at  the  expense  of  certain  projects  which  appear  to  be  sensitive  to 
cost . 

The  variable  analysis,  Table  4-11,  shows  that  six  projects 
.are  not  represented  in  the  solution  compared  to  only  three  in  run  2. 

In  addition  to  the  Integrated  R&D  Information  System  (Y^,,),  General 
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TABLE  4-10.  STALK  ANALYSIS  (Run  3) 


ROW 

AVAILABLE 

POS-SLK 

NEG-SLK 

(aj.) 

1 

491 

0 

32 

2 

454 

5 

0 

3 

8778 

0 

0 

4 

0 

0 

0 

5 

363 

0 

246 

6 

0 

1 

0 

7 

68 

0 

54 

11 

8 

13 

0 

0 

\ 

12 

9 

13 

0 

0 

13 

10 

1 

61 

0 

15 

11 

2 

0 

0 

16 

12 

1 

0 

0 

17 

13 

4 

0 

0 

18 

14 

2 

0 

0 

19 

15 

15 

36 

0 

1 

191 

16 

2 

0 

0 

1 

L 9 2 

17 

2 

0 

0 

21 

18 

91 

0 

0 

1 

22 

19 

10 

0 

0 

1 

23 

20 

62 

4 

0 

Lrojfc 

24 

21 

7 

0 

0 

”''des  > 

25 

22 

1 

0 

0 

26 

23 

23 

0 

0 

31 

24 

0 

8 

0 

32 

25 

3 

0 

3 

33 

26 

5 

0 

0 

34 

27 

1 

0 

1 

41 

28 

5 

0 

0 

42 

29 

7 

0 

0 

43 

30 

19 

0 

0 

44 

31 

17 

19 

0 

45 

32 

25 

0 

0 

51 

33 

80 

0 

80 

>11 

34 

4 

0 

0 

52 

35 

19 

0 

19 

53 

36 

5 

0 

5 

60 

37 

15 

0 

15 

38 

0 

8 

0 

39 

355020 

35503 

0 

40 

365671 

24851 

0 

41 

390522 

0 

0 

t 

42 

0 

100 

0 

43 

0 

0 

46 

44 

0 

40 

0 

45 

0 

0 

52 

46 

0 

0 

24 

47 

0 

0 

68 

”” 

48 

0 

0 

19 

49 

0 

0 

0 

50 

0 

0 

0 

A A I 

• KM 
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TABLE  4-11.  VARIABLE  ANALYSIS  (RUN  3) 


Symbol 

Name 

Variable  No. 

Amount 

X15 

R&D  Prog  Plang  DB  Input 

4 

2 

X18 

Indep  R&D  Data  Bank  Output 

7 

2 

X23 

Tech  Report  Request  Distr 

13 

66 

X!7 

Indep  R&D  Data  Bank  Input 

6 

4 

X19 

RDT&E  On-Line  Terminal 

8 

51 

X191 

RDT&E  On-Line  Term  at  Boston 

9 

2 

X192 

RDT&E  On-Line  Term  at  L.A. 

10 

2 

X22 

Tech  Report  Announcement 

12 

10 

X24 

Tech  Report  Automatic  Distr 

14 

7 

X25 

Tech  Report  Primary  Distr 

15 

1 

X26 

Tech  Report  Bibliographies 

16 

23 

X31 

Advanced  Distr  Systems 

17 

8 

Y33 

Natural  Language  Systems 

19 

5 

Y41 

RDT&E  Information  Services 

21 

5 

Y42 

Technical  Report  Systems 

22 

7 

Y43 

Integrated  Systems 

23 

19 

Y44 

RDT&E  On-Line  System 

24 

36 

Y45 

DDC  Sys  Redesign  and  Imple 

25 

25 

Y511 

4 People  for  Promotion  & Markg 

27 

4 

X11 

R&T  WUDB  Input 

1 

13 

X12 

R&T  WUDB  Output 

2 

13 

X13 

STINFO  S/R  Data  Bank 

3 

62 

X16 

R&D  Prog  Plang  DB  Output 

5 

1 

X21 

Technical  Report  Input 

11 

91 

A AT 
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TABLE  4-12.  ANALYSIS  OF  THE  OBJECTIVE  (RUN  3) 


PRIORITY 

8 

7 

6 

5 

4 

3 

2 

1 


1 

, 


UNDER-ACHIEVEMENT 

123 

300 

367 

0 

0 

0 

0 

0 
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Systems  development  (Yg^)  and  Technical  Terminology  (Z,^) » the 
third  run  solution  does  not  represent  any  management  and  adminis- 
trative staff  (Z,.j),  the  STINFO  Central  Registry  (Z..^)  or  Support 

of  non-DDC  Activities  (Z,.,). 

ou 

While  the  solution  indicates  that  the  latter  three  projects 
are  the  most  sensitive  to  a cost/benefit  analysis,  zero  support  is  unfeas- 
ible. Therefore,  an  appropriate  constraint  must  be  defined  and  added  to  the 
basic  model  to  represent  administrative  staff  requirements. 

The  Slack  Analysis,  Table  4-10,  offers  somewhat  less  obvious 
insight  to  the  cost/benefit  sensitive  projects.  The  following 
conclusions  are  based  on  a comparison  of  the  slack  analysis  from  run  3 
with  that  of  run  2. 

Project  X.^,  STINF0  Data  Bank  (a^g)  appears  to  have  a 
very  favorable  cost/benefit  evaluation  as  indicated  by  the  excessive 
positive  slack  assigned  to  it  by  the  model  in  this  run.  The  services 
designed  to  serve  RDT&E  managers  also  appear  to  have  a slight  cost/ 
benefit  edge  over  services  to  RDT&E  scientists  and  engineers.  This  is 
indicated  by  the  positive  slack  in  row  a^g.^  Furthermore,  the  systems 
support  for  the  RDT&E  on-line  service,  Y^  (a^)  evaluated  favorably 
for  cost/benef it . 

On  the  negative  side,  of  course  the  overall  staff  constraint 
was  highly  sensitive  to  cost.  The  third  solution  calls  for  only 
a slight  increase  in  staff  (a^  and  a^)  to  459.  The  decrease  principally 
affected  the  three  project  elements  noted  previously,  the  administrative 
staff  (Z,.^),  STINFO  Central  Resistry  (Z^)  ar|d  Support  for  Non-DDC 
activities  (Z^q). 

Finally,  an  interesting  reversal  of  program  emphasis  resulted 
from  the  addition  of  the  cost  constraint.  For  the  goal  criteria 
to  provide  basic  services  devoted  to  access  to  information  (a^)  anc* 


This  conclusion  can  be  confirmed  by  reviewing  the  formulation  of  the 
manager  to  scientist  ratio  constraint  in  the  previous  section. 
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to  provide  basic  services  devoted  to  access  to  DDC  held  documents 
(a,.),  the  cost  constrained  solution  emphasized  (a..)  while  the 
non-cost  constrained  solution  favored  a^- 

4.5.5  IMPLICATIONS  OF  THE  RESULT 

The  results  of  the  third  run  are  particularly  interesting 
because  of  their  cost/benefit  implications. 

Clearly,  constraints  must  be  added  to  the  model  to  provide  an 
adequate  support  staff.  However,  the  other  results  such  as  the 
reversal  of  the  program  emphasis  from  information  services  to 
document  access  services  on  the  basis  of  cost  indicate  that  the 
purpose  of  each  goal  setting  action  must  be  carefully  considered 
prior  to  its  inclusion  in  the  model.  As  seen  by  this  third  run,  the 
results  of  apparently  reasonable  modifications  to  the  administrative 
priorities  are  not  readily  predicable. 

4 . 6 CONCLUSIONS  REGARDING  THE  MODEL  TESTING 

The  study  set  out  to  answer  the  question,  whether  the  goal 
programming  technique  can  be  applied  on  a practical  level  in  DDC's 
complex  information  service  environment.  In  that  respect,  it  appears 
certain  that  goal  programming  can  provide  substantial  assistance 
to  the  agency's  decision-makers,  particularly  in  helping  to  identify 
and  resolve  apparent  goal  conflicts  among  various  levels  of  management. 

In  addition,  the  technique  will  help  DDC's  decision-makers  establish 
precise  goal  criteria  and  operating  priorities. 

However,  the  model's  numerical  values  and  constraints  should  be 
reviewed  by  the  operating  managers  prior  to  integrating  goal  programming  into 
DDC's  routine  management  practice. 
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Dr.  K.C.  Emerson 
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Office  of  the  Assistant  Secretary  of  the  Army  (R&D) 
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AFSC  DLX  B 
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Army  Material  Command 
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TABU-:  A- 


Gonl 

1.1 

1.1.1 

1.1.2 

1.2 

1.2.1 


1.2.2 

1.3 

1.3.1 

1.3.2 

1.3.3 


2.  GOAL  ORIENTED  PROGRAM  STRUCTURE  DERIVED  FROM 
ADMIN  I ST RAT  I V E I NT  E R V I KWS 


* 


•'  Conduct  Projects  to  Aid  in  Identifying;  and 
Locating  Information  its  Opposed  to  Documents 


To  Provide  a Basic  Level  of  Products  and  Services 


To  RDT&E  Managers 

provide  service  hours  (by  class  of  activity, 
e.g.,  input  vs.  itput) 
provide  computer  systems  support 
provide  purchased  services  and  material 

To  Scientists  and  Engineers 

- provide  service  hours  (by  class) 
provide  computer  systems  support 
provide  purchased  services  and  material 

To  Provide  an  Improved  Level  of  Products  and  Services 

To  RDT&E  Managers 

provide  service  hours  (by  class  of  activity, 
e.g.,  input  vs.  output) 

- provide  computer  systems  support 

- provide  purchased  services  and  material 

To  Scientists  and  Engineers 

provide  service  hours  (by  class) 
provide  computer  systems  support 

- provide  purchased  services  and  material 

To  Provide  an  Advanced  Level  of  Products  and  Services 


Investigate 

service  hours 

purchased  services  and  material 
Develop 

- service  hours 

purchased  services  and  material 

Implement 

service  hours 

purchased  service  and  material 
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Goal  2:  Conduct  Projects  to  Provide  Access  to  DoD  Documents 


I 

I 

I 

2 . 1 To  Provide  a Basic  Level  of  Service  and  Products 

2.1.1  To  RDT&E  Managers 

- provide  service  hours 

I-  provide  computer  systems  support 

provide  purchased  services  and  material 
provide  a document  inventory 

2.1.2  To  Scientists  and  Engineers 

provide  service  hours 
provide  computer  systems  support 
provide  purchased  services  and  material 
provide  a document  inventory 


2.1.3 

To 

Non-DoD  Users 

2.2 

To 

Provide  an  Improved  Level  of  Products  and 

Services 

2.2.1 

To 

RDT&E  Managers 

__ 

provide  service  hours 

- 

provide  computer  systems  support 

- 

provide  purchased  services  and  material 

— 

provide  a document  inventory 

2.2.2 

To 

Scientists  and  Engineers 

- 

provide  service  hours 

- 

provide  computer  systems  support 

- 

provide  purchased  services  and  material* 

provide  a document  inventory 

2.2.3 

To 

Non-DoD  Users 

2.3 

To 

Provide  an  Advanced  Level  of  Products  and 

Services 

2.3.1 

Investigate 

- 

service  hours 

- 

purchased  services  and  material 

2.3.2  Develop 

service  hours 

- purchased  service  and  material 

2.3.3  Implement 

- service  hours 

purchased  service  and  material^ 
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Goal  3: 


3.1 

3.1.1 

3.1.2 

3.2 

3.2.1 

3.2.2 

3.2.3 

Goal  4 
4.1 


Conduct  Projects  to  Provide  Access  to  Documents 
in  Remote  Locations 

(not  a current  service) 

To  Provide  an  Improved  Level  of  Products  and  Services 

To  Coordinate  and  Administer  Interagency 
Access  Agreements 

To  Provide  an  Interagency  Network  Capability 

- informed  personnel  for  retrieval  and  consul- 
tative service 

intersystem  computer  interchange 
To  Provide  an  Advanced  Level  of  Products  and  Services 


Investigate 

service  hours 

purchased  services  and  material 

Develop 

service  hours 

purchased  service  and  material 

Implement 

service  hours 

purchased  services  and  material 


: Conduct  Projects  to  Promote  Use  of  Information 

Products  and  Services 

To  Promote  Use  Among  RDT&E  Managers 

publications,  advertisements,  exhibits 

- seminars  and  education  programs 
personal  contact  (user  oriented  reference 
personnel,  promoters) 

user  guides 

Promote  Use  Among  Scientists  and  Engineers 

publications,  advertisements,  exhibits 
seminars  and  education  programs 

- personal  contact  (user  oriented  reference 
personnel,  promoters) 

- user  guides 
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To  Promote  Use  Among  Non-DoD  Groups 


4.3.1  DoD  Contractors 


_ 

publications,,  advertisements,  exhibits 

- 

seminars  and  education  programs 

" 

personal  contact  (user  oriented  reference 
personnel,  promoters) 

user  guides 

4.3.2 

Technical  Groups 

- 

publications,  advertisements,  exhibits 

- 

seminars  and  education  programs 

" 

personal  contact  (user  oriented  reference 
personnel,  promoters) 

user  guides 

4.3.3 

General  Public 

- 

publications,  advertisements,  exhibits 

- 

seminars  and  education  programs 

personal  contact  (user  oriented  reference 
Personnel,  promoters) 

' 

user  guides 

Goal  5: 

Administration 

5.1 

To 

Administer  DDC  Services 

5.1.1 

To 

Fund  Services 

- 

DoD  R&D  funds 

- 

user  charges 

interagency  cooperative  funding  for  advanced 
products  and  services 

5.1.2 

To 

Administer  Personnel 

maintain  full  production  capacity 

specify  staff  positions  by  staff  skill  and 

characteristics 

specify  total  number  of  staff 

specify  the  distribution  of  staff  by  project 

specify  salary  and  grade  levels 


111 


5.2 

To 

Plan  DDC  Services 

5.2.1 

To 

Prepare  Programs,  Proiects  and  Budgets 

5.2.2 

To 

Set  Target  Levels  for  the  Output  of  Products 

and  Services 

5.2.3 

To 

Provide  Resources  for  DDC  Development  Proiects 

5.3 

To 

Provide  Support  for  Services 

5.3.1 

To 

Provide  Systems  Support 

- 

Provide  for  systems  upgrading  and  equipment 
replacement 

5.3.2 

To 

Purchase  Materials 

- 

supplies 

contract  services 
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Arbitrary  Itigns  and  Symbols 


Signs  and  Symbols 

T. 


Meaning 
Summati on 


7T 


Product 


d+ 

d~ 


( ) 
[ 1 


Positive  deviation  from 
a goal;  over  extension 


Negative  deviation  from 
a goal;  under  achievement 


Parentheses 

Brackets 


indicate  that  the 
quantities  enclosed 
within  are  to  be 
taken  together 


x,  y,  z Decision  variables: 

x represents  a basic  variable 

y represents  an  investment 
variable 

z represents  miscellaneous 
variables 
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APPENDIX  C. 

Dftta  Tables  Used  in  the  Construction  of 
the  DDC  Model 
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TABLE  C-l.  DECISION  VARIABLES* 


Sequence 

No. 


Decision  Variable 


Name 


Basic/ Investment 


1 

*1.1 

2 

X1 . 2 

T 

Xl.  3 

4 

X1 . 5 

5 

X1.6 

6 

x1.7 

7 

x1.8 

8 

*1.9 
x „ 

9 

1.9.1 

10 

Xl. 9. 2 

11 

x2 . 1 

12 

x2. 2 

13 

X2.3 

14 

X2.4 

15 

X2.5 

16 

X2.6 

17 

y 3. 1 

18 

y3. 2 

19 

y3.3 

20 

y 3.  4 

21 

V4.  1 

22 

y4.2 

23 

y4.J 

24 

y4. 4 

25 

y4. 5 

26 

Z5.1 

27 

Z5. 1. 1 

28 

Z5.2 

29 

5.3 

z,  _ 

30 

6.0 

-k 

Decision  Variables  are 
allocated. 


R&T  WUDB  Input  B 

R&T  WUDB  Output  B 

STINFO  S/R  Data  Bank  B 

R&D  Prog  Plang  DB  Input  B 

R&D  Prog  Plar.g  DB  Output  B 

Indep  R&D  Data  Bank  Input  B 

Indep  R&D  Data  Bank  Output  B 

RDT&E  On-Line  Terminal  B 

RDT&E  On-Line  Terminal  at  Boston  B 

RDT&E  On-Line  Terminal  at  Los  Angeles  B 
Technical  Report  Input  B 

Tech  Report  Announcement  B 

Tech  Report  Request  Distr  B 

Tech  Report  Automation  Distr  B 

Tech  Report  Primary  Distr  B 

Tech  Report  Bibliographies  B 

Advanced  Distr  Systems  I 

Integrated  R&D  Info  Sys  I 

Natural  Language  Systems  I 

General  Systems  I 

RDT&E  Information  Services  201  : 80B 

Technical  Report  Systems  201  : 80B 

Integrated  Systems  601  : 40B 

RDT&E  On-Line  System  501  : 50B 

DDC  Sys  Redesign  and  Imple  I 100% 

Management  and  Admin 

4 People  for  Promotion  & Marketing  B 

Technical  Terminology  B 

STINFO  Central  Registry  Z 

Support  of  Non-DDC  Act  Z 


the  program  elements  to  which  labor  resources  must  be 
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TABU'  C-2 . SOURCES  OF  DATA 


CONSTRAINTS 

SOURCE  OF  DATA 

Symbol 

Description 

x,  y,  z 

decision  variables,  projects  to 
be  evaluated  (Table  C-l) 

1978  program  budget  as 
modified  by  DDC  manage- 
ment . * 

al 

Upper  limit  on  the  number  of  staff 
feasible  (10%  over  previous  year, 
i.e.  491) 

Administration  Interview 

a2 

Total  staff  targeted  for  the  1978 
Program/ Budget  (454) 

1978  Prograra/Budget 

a3 

ci 

Available  labor  budget  ($8,778,000) 
Estimated  labor  cost  per  project 
man-year. 

1978  Program/ Budget 

a4 

Desired  apportionment  of  program 
labor  devoted  to  basic  services 
(85%) 

Set  by  management 

a5 

Ei 

No.  of  man-years  available  in  the 
budget  for  basic  services.  Esti- 
mates of  probable  effectiveness 
(See  Table  C-3). 

1978  Program/ Budget 
Estimated  by  management 

a6 

Desired  apportionment  of  program 
labor  devoted  to  investment  ser- 
vices (15%) 

Set  by  management 

a7 

No.  of  man-years  available  in  the 
budget  for  basic  services.  Esti- 
mates of  probable  effectiveness 
(See  Table  C-3). 

1978  program/ Bud get 
Estimated  by  management 

ag  through 
a37 

Target  levels  for  the  individual 
programs  in  the  1978  Program/ 
Budget 

1978  Program/Budget 

^Defense  Documentation  Center  Research,  Development,  Test  and  Evaluation 
(RDT&E)  Program/ Budget  F:.scal  Year's,  197T/1977/1978.  27  August  1976. 
Defense  Supply  Agency.  Department  of  Defense,  Washington,  D.C. 
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| TABLE  C-2,  SOURCES  OF  DATA  (cont'd) 


CONSTRAINTS 

SOURCE  OF  DATA 

Symbol 

Description 

a38 

Desired  ratio  of  service  for  RDT&E 
managers  to  service  for  scientists 
and  engineers  (1:7) 

Ratio  set  by  management. 
Principal  group  served 
per  project,  identified 
by  management. 

a39  through 
a41 

P23 

Number  of  technical  reports  to  be 
distributed  to  libraries. 

Productivity  coefficient  per 
man-year 

Target  levels  for  mini- 
mum, moderate  and  excel- 
lent service  set  by 
management, 

1978  Program/Budget 

through 

a48 

Desired  apportionment  of  man- 
power among  functional  organization 
goals 

The  goals  are  derived 
from  the  administrators' 
interviews.  The  criteria 
and  goals  served  per 
project  are  defined  by 
management. 

a49  and 
a50 

Desired  apportionment  to  services 
designed  for  specific  user  needs 
(Timeliness,  comprehensiveness) 

The  goals  are  derived 
from  the  administrators' 
interviews.  The  criteria 
and  goals  served  per 
project  are  defined  by 
management . 
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If  an  equitable  destribution  of  resources  is  to  be  made  to  a 
list  of  proposed  projects  in  accordance  with  effectiveness  attributes, 
it  is  necessary  to  define  a matrix  of  effectiveness  factors  and  score 
each  proposed  project  accordingly. 

The  total  score,  represented  by  Ei,  determines  the  weight  of 
a proposed  project  in  competing  for  available  resources.  The  higher  the 
score,  the  more  likely  it  is  to  receive  resources. 

14  effectiveness  factors  (ef)  were  used  to  calculate  scores  for 
the  study  model: 


efj 


ef 

ef 

ef 

ef 

ef 

ef 

ef 


2 

3 

4 

5 

6 

7 

8 


ef10 
e f 1 1 
ef  12 
ef13 
ef14 


1  point  if  the  program  provides  aid  in  locating  information 
as  opposed  to  documents. 

1 point  for  programs  which  provide  access  to  documents  held 
by  DDC . 

1 point  for  programs  which  provide  access  to  documents  in 
remote  locations. 

1 point  for  programs  which  promote  the  use  of  information 
products  and  services. 

2 points  for  programs  serv;ng  primarily  RDT&E  managers. 

1 point  for  programs  serving  primarily  Scientists  and  Engineers. 

1 point  for  service  to  non-DoD  users. 

“t  points  for  programs  serving  libraries  or  other  intermediary 
information  organizations. 

3 points  for  programs  providing  ADP  systems  support  for  the 
overall  program. 

1 point  for  timeliness  of  service  (24  response  time) 

1 point  for  volume  of  use  (5  most  used  products  or  services) 

1 point  for  user  satisfaction  (5  most  well  received  products/ser . ) 
] point  for  collection  comprehensiveness 

1 point  for  conservation  of  the  products  of  DoD  RDT&E  Research 


Project  scores  were  provided  by  DDC  and  are  shown  in  Table  C-3a. 
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The  ucores  in  Table  C-3a  represent  a measure  of  the  ability  of 
each  project  to  contribute  to  meeting  specific  organizational  goals.  Both 
new  and  old  projects  are  evaluated  on  an  equal  basis  in  this  measure. 
However,  it  is  important  to  recognize  that  drastic  program  changes  including 
discontinuing  established  projects  in  favor  of  new  ones  can  be  counter- 
productive. Therefore,  a second  aspect  of  probable  effectiveness  is 
considered:  the  willingness  of  management  to  commit  resources  to  specific 

projects,  e^.  This  second  measure  will  tend  to  favor  the  established 
projects . 

The  value  of  e2  is  implied  by  the  proportion  of  resources 
assigned  each  project  in  the  1978  Program/Budget.  Values  supplied  for  the 
model  are  shown  in  Table  C-3b. 
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Setting  up  Goal  Program  Problems  for  Computer  Solution 
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This  appendix  presents  step-by-step  procedures  for  setting 
up  goal  program  problems  for  computer  solution.  The  format  is  de- 
signed for  the  computer  program  listed  at  the  end  of  the  appendix. 

It  discusses  the  data  input  process,  the  computer  deck  set-up,  and  the 
interpretation  of  the  reports  that  are  generated.  The  program  as 
described  by  Lee,  is  capable  of  solving  problems  with  up  to  125  vari- 
ables (including  slack  variables),  60  constraints  and  10  priority 
levels. ^ 

DATA  INPUT  PROCESSES 

To  illustrate  the  data  input  process,  the  problem  described 
in  Section  III  of  this  report  is  described.  However,  as  the  DDC  model 
consists  of  50  goal  criteria  (constraints)  and  30  variables  only  a few 
exmaples  will  be  used  to  illustrate  the  procedures. 

A.  Preparing  the  Data  for  Keypunch  Card  Input 

The  problem  input  deck  has  five  parts:  (1)  problem  card, 

(2)  the  sign  card,  (3)  the  objective  function,  (4)  the  substitution 
rates,  and  (5)  the  right-hand  side. 

1.  The  Problem  Card 

The  problem  card  defines  the  problem  parameters.  Its  format  is: 
Col.  1-4:  punch  PROB 

Col.  5-7:  the  number  of  constraints  and/or  goals 

Col.  8-10:  the  number  decision  variables  (i.e.  projects) 

Col.  11-13:  the  number  of  priority  factors 

The  constraints  of  course,  refer  to  the  number  of  goal  criteria. 
The  decision  variables  refer  to  the  number  of  projects  to  be 
evaluated.  The  number  of  priority  factors  represents  the  number 
of  actual  priority  levels  perceived  by  management.  Artificial 
priorities  may  be  aucomatical ly  created  by  the  program  in  order 
to  create  the  first  basis. 


^ Sang  Lee,  Goal  Programming  for  Decision  Analysis,  AL'ERBACH , 
Philadelphia,  Pa.  1972. 
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For  the  initial  DDC  model,  there  are  50  constraints,  30 
projects  and  seven  priority  levels  as  illustraed  in  Figure 
1. 
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Card  Identification 


Col 


No. 

Const raints 

I No.  Decision  Variables 

No.  of  Priority  I.evc 

n 34 

Ln 

O' 

8 9 10 

11  12  13 

P R 0 B 

0 5 0 

0 3 0 

0 0 7 

Figure  1.  The  Problem  Card 


2.  The  Sign  Card 

The  sign  card  describes  the  "goal"  with  respect  to  each 

constraint.  The  model  is  permitted  to  seek  solutions  in 

accordance  with  the  following  four  parameters: 

a.  B indicates  that  management  wants  to  minimize  deviation 
in  either  positive  or  negative  direction  from  each 
respective  criterion.  However,  this  also  means  that 
the  model  may  deviate  in  e ither  direction. 

b.  G indicates  that  the  model  may  seek  solutions  only 
greater  than  the  stated  criterion.  Any  value  less 
than  the  criterion  is  unfeasible  and  will  be 
rejected  by  the  model. 

c.  L indicates  that  the  model  may  seek  solutions  only 
less  than  the  stated  criterion. 

d.  E indicates  exactly  equal . No  deviation  in  either 
direction  is  feasible. 


Example:  The  sign  card  for  the  initial  DDC  model  is  illustrated 

in  Figure  2.  It  is  derived  from  Table  3-8  in  Section  III. 
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3.  The  Objective  Function  Cards 

The  objective  function  cards  indicate  the  priority  factors, 
the  constraints  they  are  associated  with  and  type  of 
deviation  from  the  criteria  (either  positive  or  negative) 
that  management  chooses  to  minimize.  The  objective  function 
cards  are  preceded  by  an  identifier  card  with  "OBJ"  in  the 
first  three  columns.  The  format  for  the  objective  function 
cards  is  as  follows: 


Col.  1-3:  Key  either  POS  (Positive)  or  NEG  (Negative). 

This  indicates  the  deviational  direction 
that  is  to  minimized. 

Col.  8-9:  The  constraint  with  which  the  deviational 

variables  are  each  associates. 

Col.  13-14:  The  priority  levels  at  which  the  deviational 

variable  is  to  be  minimized.  (Both  positive 
and  negative  deviation  can  be  minimized  at 
independent  priority  levels.  No.  1 is  the 
highest  priority. 

Col.  15-25:  The  weight  coefficient  of  the  priority  factor. 

If  all  the  variables  have  equal  weight,  1.0 
must  be  indicated.  The  decimal  place  must 
be  indicated,  even  if  the  value  is  a zero. 


Example:  An  example  of  objective  function  cards  is  provided 

in  Figure  3 for  the  first  3 constraints  of  the 
initial  model. 
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4.  The  Data  Section  Cards 


I 

(The  data  section  cards  specify  the  coefficients  of  the 

decision  variables  as  applied  to  each  of  the  50  constraints. 

There  is  one  card  for  each  variable  in  each  constraint..  The 
f data  section  cards  are  identified  by  a preceding  card  with 

DATA  punched  in  columns  1-4.  The  format  for  the  data  cards 
•*  is  as  follows: 

I Col.  8-9:  The  constraint  in  which  the  coefficient  value 

is  located. 

Col.  13-14:  The  number  of  the  decision  variable  associated 

wich  the  coefficient 

Col.  15-25:  The  value  of  the  coefficient 

Example:  For  the  DDC  model,  the  data  coefficients  for  constraints 

a 2 and  a^  are  as  illustrated  in  Table  D-l. 


TABLE  P-1.  DATA  COEFFICIENTS  FOR  CONSTRAINTS  a,,  and  a 3 


Constraint : 

a2  (Total  Staff) 

a^  (Cost) 

Distribution : 

The  sum  (E)  of  all  the  staff 

The  sum  (E)  of  the  number  of 

assigned  to  each  of  the  30 
proj  ects 

man-years  times  the  average 
cost  (c^)  per  man-year  of 
each  of  the  30  projects 

Formulation : 

(1-X)+(1-Y)+(1-Z)  = a2 

(C.  •X)+C.-Y)  + (Ci-7.)  = a3 

Variable : 

Value 

Ci  Value  from  Table  3-3 

1 (V 

1.0 

13.92 

2 (Xl2) 

1.0 

19.85 

3 (X13) 

1.0 

20.0 

4 <X15> 

1.0 

16.0 

5 ‘V 

1.0 

20.0 

• 

• 

• 

50  <Z60> 

1.0 

19.07 
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Figure  4 illustrates  the  form  in  which  the  data  coefficients 
are  entered: 


Decision 

Identifier  Constraint  Variable  Value 


5.  The  Right-Hand-Side  Cards 

The  right-hand-side  cards  are  preceded  by  a card  labeled  "RGHT" 
punched  in  the  first  four  columns.  The  format  for  entering 
the  right-hand-side  values  is  as  follows: 


Col. 

1-10: 

right -hand-side 

value 

for 

the 

first 

constraint 

(a.) 

Col. 

11-20: 

right -hand- side 

value 

for 

the 

second 

constraint 

<a2> 

Col. 

20-30: 

ri ght-hand-s ide 

va  1 ue 

for 

the 

third 

constraint 

(a3) 
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Col.  71-80:  right-hand-side  value  for  the  eighth  constraint  (aQ) 

o 

When  there  are  more  than  eight  constraints,  simply  go  to 
the  next  card. 

Example:  For  the  DDC  example,  the  right-hand-side  cards 

are  (from  Table  3-8): 


'\Col^ 

S 

10 

20 

30 

40  . . 

80 

Card  1 
2 

RGHT 

491 

454 

0.0 

0.0 

13.0 

3 

13.0 

1.0 

2.0 

1.0  . . 

2.0 

etc . 

B.  Input  Card  Deck  Set-l'p 

The  order  of  cards  for  the  computer  input  deck  is  as  follows: 

1.  Appropriate  Systems  Cards  from  the  Computer 
Facility  Begin  Used 

2.  Goal  Program  FORTRAN  Deck 

3.  Problem  Card  (PROB) 

4.  Sign  Cards 

5.  Objective  Function  Identifier  Card  (OBJ) 

6.  Objective  Function  Cards 

7.  Data  Identifier  Card  (DATA) 

8.  Data  Section  Cards 

9.  Right-Hand-Side  Identifier  Card  (RGHT) 

10.  Right-Hand-Side  Data  Cards 

11.  System  End  Card  from  the  Computer  Facility 


C.  Reading  of  the  Computer  Pu‘ put  Reports 

The  computer  solution  provides  the  following  output:  complete 
printout  of  input  data,  the  final  simplex  solution  table,  slack  analysis 
report,  variable  analysis  report,  and  the  analysis  of  the  objective. 
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As  an  aid  to  reading  these  reports,  the  following  explanations  are 
provided : 


1 . Input  Data 

The  computer  prints  out  the  complete  input  data  so  that  the  user  of 
the  program  can  easily  recheck  the  data  he  has  fed  into  the  computer. 

For  the  DDC  example,  the  computer  printout  is  too  large  to  present 
effectively  as  an  example.  Therefore,  mock  data  are  used  in  the 
following  illustrations: 


THE  RIGHT  HAND  SIDE- INPUT 
1 80.00000 

2 70.00000 

3 AS. 00000 

4 90.00000 

THE  SUBSTITUTION  RATES-INPUT 

Row  1 

1.000  0.0  0.0  0.0  -1.000  0.0 

ROW  2 

0.0  1.000  0.0  0.0  0.0  0.0 


ROW  3 

0.0  0.0  1.000 

ROW  4 

0.0  0.0  0.0 

THE  0BJECTI 

PRIORITY  4 

0.0  0.0  0.0 

PRIORITY  3 

0.0  5.000  3.000 

PRIORITY  2 

0.0  0.0  0.0 

PRIORITY  1 

1.000  0.0  0.0 


0.0  0.0  0.0 

1.000  0.0  -1.000 

YE  TUNCT ION- INPUT 

0.0  1.000  0.0 

0.0  0.0  0.0 

1.000  0.0  0.0 

0.0  0.0  0.0 


PAGE  01 


PAGE  02 

1.000  1.C00 

1.000  0.0 

0.0  1.000 

1.000  1.000 

PAGE  03 

0.0  0.0 

0.0  0.0 

0.0  0.0 

0.0  0.0 
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The  Input  Data  Report  is  read  as  follows: 

a.  Right-Hand-Side  Input:  these  are  values  entered  for 

the  goal  criteria. 

b.  The  Substitution  Rates  - Input:  these  are  coefficients 

entered  for  the  data  cards. 

c.  The  Objective  Function  - Input:  these  specify  the  de- 

viational  variables  that  are  to  be  minimized  and  the 
weights  assigned  to  them  in  each  priority. 

These  reports  merely  read  back  the  data  that  were  entered  in 
order  for  the  analyst  to  ensure  that  no  keying  errors  were 
entered.  Consequently,  they  should  be  self-explanatory. 

However,  it  should  be  pointed  out  that  whenever  the  full  model 
matrix  is  printed  out,  as  in  the  substitution  rates  and  the 
objective  function  matrices,  the  sequence  of  the  data  elements 
is  as  follows: 

• first,  all  the  negative  deviational  values  are 
indicated  (i.e.  for  the  DDC  model  the  first  50 
data  elements  represent  the  negative  deviations 
(dT)  in  the  complete  model) 

• second,  the  positive  deviation  values  in  the  model 
are  presented  (dt) 

• finally,  the  remaining  data  elements  represent  the 
decision  variables 

For  the  example  provided  here,  the  first  four  columns  represent 
A negative  deviational  variables,  whereas  the  DDC  model  has 
50.  The  fifth  and  sixth  columns  represent  2 positive  deviational 
variables,  whereas  the  DDC  model  has  A3.  The  last  two  columns 
of  the  example  are  decision  variables.  DDC  has  30  (i.e. 
the  project  list). 

2.  The  Final  Simplex  Solution  Table 

The  computer  program  provides  the  final  simplex  matrix.  This 
report  is  primarily  useful  for  the  analyst  familiar  with  linear 
programming  for  whom  the  notation  is  self-explanatory.  As  DDC 
personnel  become  skilled  in  the  goal  programming  technique,  it 
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wouLci  be  advisable  to  consult  a basic  text,  particularly 
Lee's  (see  Lee  (50) in  the  bibliography)  for  a full 
explanation  of  the  simplex  solution  matrix  and  its  inter- 
pretation. However,  in  the  introductory  phase  the  simplex 
matrix  is  not  required  for  the  type  of  analysis  demonstrated 
in  Section  IV. 

3.  The  Slack  Analysis  Report 

The  Slack  Analysis  Report  presents  the  input  values  of  the  right- 
hand-side  and  the  final  solution  volues  of  the  negative  and  pos- 
itive variables  for  each  equation.  The  slack  analysis  indicates 
the  details  of  goal  attainment;  that  is,  the  amount  both  under- 
achieved or  exceeded.  If  both  negative  and  positive  slack  values 
are  zero,  the  respective  has  been  met. 


SLACK  ANALYSIS 

PAGE  06 

ROW 

AVAILABLE 

P0S-SLK 

NEG-SLK 

1 

80.00000 

10.0000 

0.0 

2 

70.00000 

0.0 

0.0 

3 

45.00000 

0.0 

25.00000 

4 

90.00000 

0.0 

0.0 

The  slack  analysis  is  to  be  interpreted  as  meaning  that  of  the  four 
constraints  (rows),  numbers  2 and  4 are  met.  Number  1 was 
exceeded  by  10  units  (in  the  DDC  examp  e,  that  might  have  meant 
the  solution  called  for  10  man-years  more  than  available),  and 
number  3 was  underachieved  by  25  units  (for  example,  the  number 
of  man-year  allocated  to  investment  programs  might  have  come  up 
25  positions  short  of  what  was  desired). 

4 . Variable  Analysis 

The  variable  analysis  presents  the  final  values  of  the  decision 
variables  (i.e.  the  projects  that  iv  lived  the  resources).  When 
the  problem  under  consideration  is  very  complex  one,  the  variable 
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analysis  is  especially  helpful  because  it  presents  only  the 
constants  of  the  decision  variables,  as  compared  to  the 
final  simplex  solution  table. 

The  variable  analysis  of  the  mock  example  appears  as  follows: 

VARIABLE  ANALYSIS  PAGE  07 

VARIABLE  AMOUNT 

1 70.00000 

2 20.00000 

It  should  be  pointed  out  here  that  the  variable  numbers  are 
arranged  such  that  they  refer  to  the  list  of  decision  variables 
(i.e.  the  projects:  X,  Y and  Z ). 


5 . Analysis  of  the  Objective 

An  analysis  of  the  objective  presents  the  sum  total  value  (I) 
for  the  goals  in  the  objective.  These  values  represent  the 
underattained  portion  of  goals.  If  the  model  requires  assign- 
ment of  artificial  priority  to  set  up  the  initial  table,  the 
artificial  priority  will  also  be  printed  out. 

For  the  mock  example,  the  print-out  of  the  analysis  of  the  ob- 
jective appears  as  follows: 


ANALYSIS  OF  THE  OBJECTIVE 


PAGE  08 


PRIORITY 

4 

3 

2 

1 


UNDERACHIEVEMENT 

10.00000 

75.00000 

0.0 

0.0 
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It  should  be  obvious  that  goals  1 and  2 are  completely  met. 
Goal  3 represents  the  value  of  the  negative  slack  indicated 
in  row  3,  times  a "mock"  priority  weight  factor  (in  this 
case  a weight  of  3).  The  weight  is  arbitrary  and  merely 
supposed  for  illustrative  purposes.  The  value  of  the  fourth 
priority,  i.e.  10, represents  the  failure  of  the  solution  to 
minimize  the  overachievement  of  row  1 (see  the  slack  analysis) 
to  zero. 

The  remainder  of  the  appendix  presents  the  FORTRAN  program 
used  in  this  study  to  calculate  the  goal  program  solutions. 
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?mtn=amT  ( 1) 

0071 

Mr! 

0 0 7 8 

22  0 

1 = ) ♦! 

0 0 7 3 

IF(I-M)  230,230,300 

0 0 74 

230 

IF (AMT ( j ) ) 22 0,240,240 

0 0 75 

?40 

IF(7  'I'.-/P  T(I)|  220,220,210 

C 

REMOVE  Y(M) 

0076 

300 

Y (F  1 ) = < ( K 2 ) 

0077 

DO  310  K * J , L 

0078 

V A | Y ( K 1 , K ) rVALX  (K,K2) 

0079 

31  0 

C0‘.  T INuE 

C 

CAl.CUL  A TE  NFW  RIGHT-HAND  SIDES 

0080 

DO  400  1=1, N 

0081 

PRrT ( I ! =PR0T ( I ) -ZMIN*C ( I , K 2 ) 

0 0 8,* 

400 

CO'  T INUE 

0OH3 

PRf'T  ( K 1 ) r2l*JN 

c 

cmcolatf  NEW  SUBSTITUTION  RATlS 

0 004 

DO  500  J=1 ,M 

0085 

DO  500  1 = 1 , N 

0 086 

D(l,J)=C(I,J)-C(Kl,J)*  C(I,K2)/C(K1,K2) 

008  J 

500 

CO'  T IN' IF. 

T0R8 

DO  510  J*1,M 

0089 

D(k1,J)=C(K1,j)/c<M*K2> 

0090 

510 

CO'  iT  1UIIE 

0091 

DO  520  J*1»M 

0092 

DO  520  I=1,N 

0 09  J 

C ( l , J) =0 ( l , J) 

00«»4 

IF  ( Ali  S ( C ( 1 , J ) ) .LF«0.00001)C(T*J)=0, 

0093 

520 

co-  t due 

009b 

ITF.lsJ  TER,  1 

* 

C 

WRITE  ALL  Tables  0"  JUST  OPTIMAL  table 

0097 

IFlITAMl  WO, 40, 600 

c 

WRITE  EACH  TABLE 

0098 

600 

WRTTF(6,6001)  ITER 

0 09  9 

60»1 

1 OPMA T I 1H1 , 1 OX, 13HI TEWAT IONS  = ,13,//) 

0100 

WHITE (6,5001) 
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» 


fi  'THAN  Iv  0 LfcVtL  2 1 MAIN  DATF  = 77070 


0101 

DO  61 0 I = 1 ,U 

01  02 

IY ( I > sv  ( T > 

ninJ 

*RT  TE (6  til  11  T Y ( I ) * PHOT  ( I ) 

0 1 04 

6 1 0 

CO:  TINUE 

01  as 

WR T IF (6*600?) 

0 1 06 

00  620  1=1.0 

0 107 

WR  I TF  (6.6006) I 

O10H 

WPITFI6.12)  (C ( I . J> t J=1 *M) 

niov 

h20 

CO*  T I 'Ji  IF 

0110 

wRJTF (6.5001) 

0111 

68  13 

DO  6814  6=1, L 

01  1? 

MM=|_  ♦ 1 _K 

01  1 i 

w R T T t (6.601)7)  MM 

oil** 

«*prrF(6,i2)  ( p vl x < 6 » j ) , j=i,m) 

0 1 1 rJ 

6M  4 

CONTINUE 

0116 

c 

GO  TO  40 

MO  V F TO  NEXT  LOWEH  PMIOPITY  LEVEL 

01)7 

7 VO 

L 1 =L 1 ♦ 1 

011b 

c 

GO  TO  02 

WRITF  FINAL  PF5ULTS 

011^ 

600 

WHI TF  <6, 1 0 1 5) 

o 1 20 

1016 

FORMAT  (1-31) 

0 1 P 1 

wRT TF  (6,1014) I TFP 

n i 22 

1 n 14 

FORMAT  ( 1 PX  , • I TFPAT  ' , 16) 

0 1 2 1 

rtp  I Jl  <-,  , 6000  ) 

p l 24 

5000 

FORMAT  (r'6X,  • THF  SIMPLEX  SOLUT I ON • » 25X , • P AGE  06',//) 

0125 

» R T TF  (6,6001 ) 

0 1 2b 

5001 

F OF  MAT (//» • THF  PlGHT  HAND  SIDt',//) 

0 1/7 

60  1 

DO  610  I=1.N 

1 1 2 6 

I Y ( I) =Y  ( I ) 

0 12V 

HPT  TF  (6,113)  I Y ( I ) * PHOT  ( I ) 

Olio 

f 1 0 

CO*  TlNNE 

01  Jl 

WRITE  (6,6(102) 

0 1 1/ 

6002 

Fir.'MA  T (//.  » THE  SUBSTITUTION  HATES',//) 

013  J 

Mil 

DO  612  I=1,N 

n ) ?<* 

»“ITF (6.6006)  I 

C 1 16 

6006 

E Ouw  A T (lx, 1HROW ,15) 

61  lo 

WRITE (6. 1 2) (C ( I , J) * J=J ,M> 

0117 

0 12 

CO'-  T T nUE 

n 1 lb 

API TF (6,6001) 

0139 

6003 

F ()6M  a r ( //  , ’ THF  ZJ-CJ  MATRIX',//) 

0 140 

fill 

no  814  K = 1 ,|. 

nui 

f 4 M s L ♦ 1 -K 

r l 42 

wRTTE (6,6007)  MM 

0 143 

500  7 

FORMA  T ( 1 X, 6HPRI0RI T Y, 16) 

1)  1 44 

WE  J TF (6, 1 2)  (RVLX  <*, J) ♦ J= 1 »M) 

p 1 45 

H 1 4 

CD’  T I'OiF 

r 

EVALUATE  OHJFCTIVE  function 

0 1 4b 

DO  620  K= 1 »L 

0147 

ZV'L  (t*  ) =0. 

0 148  • 

DO  0 2 0 I = 1 , N 

0 1 45 

ZVAL(f)=7VAL(K)  .PHOT ( I ) • V AL  Y ( I , K ) 

0 160 

82  0 

COUll NUE 

0161 

WRJ  TF (6,6004 ) 

0 162 

5004 

F0RmaT(  • AN  EVALUATION  OF  THE  OHJECTIVE  FUNCTION') 

0)63 

DO  621  K=1.L 

AAI 

• ItM  H 


I 

I 
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Fntf THAN  IV  < 

• LEVEL 

?1  main  date  = 77070 

P1S4 

k k = l - k 

IT  ( TEST.ru. 1 ,0>GO  To  ft 9 

OlSb 

KK ifK ♦ 1 

nis7 

I TE  ('nib)  KK.ZVAL  <k) 

nisti 

H/l 

CO'  T IMi'E 

ft  1 «w 

Col.  L f T i J I SM  ( KhS  1 ,P'<DT.VALY.L  .KPCK.Y.N,  KEPT.  TEST) 

0 1 hO 

(■  Jo 

ni6l 

J ► n 

I 

I 
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FiRTni.  )/  b I.  *•  . cL  21  STA  I DATE  3 7 7 0 7 0 12/21/lh 


onn  l 

SUuuiUT  I fit  stAf»T(i;lK0<iS«NVAHtNHMT*C»V6LXtVALY»RHS  tRHSl  »KPC*  .KEPT  *T 
%EST  ) 

C 

THE  START  SUBROUTINE  IS  DESIGNED  TO  TAKE  INFORMATION  IN  A SPED- 

c 

IFirn  FOOMftt  AND  TRANSFORM  IT  INTO  A SFRIES  OP  USABLE  MATRICIES. 

c . 

POQ? 

RF.aL  Nr  G 

000  i 

hfh.  l 

oooa 

1)  I "ENS  I ON  C ( 60  * 1 29 ) *VALX(10»l?b) 

0009 

D I DENS ! ON  V ALT  ( 60  i 1 0 ) 

0 0 0 b 

01 "ENS I ON  EUUALS (6U)  (RVLX ( 10* 1^5) 

0007 

OKI  NS  I ON  PHS  <60  ) 

OPOH 

0 I "f  NS  I OE  KEPT  (60) 

ooov 

0 1 ”L  NS  I ON  MHS1  (60) 

0010 

NV=1?9 

001  1 

(19  = 6 0 

00  1? 

1 

FORMAT ( A 4 * 3 I 3 ) 

0013 

DATA  POS  * NF  0/ • POS  ’ * • NEG  */ 

0014 

data  r>  a t a / * o a t a • / 

o n i 9 

UAT>»  0P.J/'0‘-,J  •/ 

001b 

data  pror/'PROB'/ 

0017 

DATA  H /•*}•/ 

oo  i a 

DATA  E.OiL/'F'i'G'i'LV 

0019 

data  «ght/»«ght»/ 

oo?o 

TES  T = 0t0 

c 

c 

c 

c 

c 

RF  AO  THE  PROBLEM  CAPO  FOR  THE  NUMBER  OF  RU WS t V AK I ABLE S * AND 

Cj 

u • 

< • t | • 1 | 1 • • • 1 • f ( I • ••  M , , ( | « 1 • M M M | ( J M M • 1 f f M ( • • • < M M 1 f • | M 

no?i 

10 

RE  AD <5* l) ANAME»HRO  S*NVAR*NPRT 

00?2 

L I SPsNPRT ♦ 1 

0023 

IF (NVAP.LE.01  GO  TO  1020 

0024 

If  (NPRT.Lt . 0)  GO  TO  10?0 

0 029 

IE  (NBO'lS.LE.O)  GO  10  10?0 

0 0 ?b 

IF  (ANA-'E.NF.PPOR)  60  TO  901 

c 

c 


C 

READ  THE  SION  CARO. 

C 

IT  rILL  CONTAIN  ONE  OF  THE  FOLLOWING  LETTERS  FOR  EACH  ROW 

C 

FOR  COUAI.S 

E 

C 

FOR  L r 6S  THAN  OR  ENIIaL  TO 

L 

C 

FOR  GREATER  Than  OP  EQUAL  TU 

G 

— 

c 

c. 

FOR  RUTH  DEVIATIONS 

H 

0027 

PEM)  (9. 1 1 ) (EOUALS (I) . 1 = 1 »NR0«S) 

002b 

c 

11 

FORMAT  (BO*- 1 i 

0029 

c 

Na»t  = o 

0 

c 

c. 

COUNT  The  NUMI-ER  OF  POSITIVt 

SLACK  VARIABLES 

0030 

NF | os=n 

0031 

00  1?  1=1*NR0WS 

0032 

IF  ( E DUALS  ( I ) .EQ.Fi)NFlDS  = NFlOS»l 

0033 

12 

IF (EQUALS ( I ) .EO.G) NFL0S=NFLDS*1 
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AAI 


FORTRAN  ] ; f.  LlvEL 


2]  START  UATF  * 7 7 0 7 0 12/21/16 

I c 

C 

C TEST  E OH  SIZE 


003*  NSIZL  = NFLl-’S*NROWS*NVAR 

0035 ir  (NOQSS.GT.MP)  GO  TO  911 


0 036 

c 

IF  (NSI7E.GT.NV)  GO  TO  oil 

C 

C 

c 

CLFaR  all  matmicies 

0 037 
0036 
00  3* 
00*0 
00*1 
no  *2 

1105 

1106 

IF  (NPPT.GT.NROWS)  GO  TO  1105 

NIP'  a MHO'S 

00  TO  1106 

MJM  = "PR  I 

K (>i  i()  = NPRT  ♦ 1 

on  16  J= 1 * MS  I 7F 

00*3 

UO  16  I = 1 , NUM 

no** 

KEPT ( I) =0 

00*5 

IF  ( 1 .GT.KDIJO)  GO  TO  17 

00*0 

K=  I 

no*  7 

w vi  x (k, j)=o.o 

0 0*6 

VA|  X (K  , J)  =0.0 

00** 

17 

IF(I.EO.J)  C(I,J>=1.0 

0050 

V*|  Y ( I ,K  ) =0. 0 

oost 

IF(I.NF.J)  C(I».J)=0.0 

0062 

16 

CONTINUE 

0053 

KPfK=0 

006* 

KsKDIir) 

C 

C 


n 065 

C 

C 

C, 

ADJUST  THE  SLACK  VARIABLES  ANO  OBJECTIVE  FUNCTION  TO  MEET  THE 
REQUIREMENTS  OF  THF  SIGN 

00  13  I = l.NR()lvS 

0066 

0057 

0058 

nos* 

006V 

oom 

1* 

IF (LUUALS t I ) .KO.E ) GO  TO  1* 
IF  (EQUALS ( I ) .EQ.G)  GO  TO  15 
IF(COOaLS«I).EQ.L>  GO  TO  13 
IF  (EQUALS ( I ) .FO.HIOO  TO  lfl 
GO  TO  RIO 
J=J 

0 062 

VALX (K, J) =1 .0 

0063 

NAPTrNftRT* 1 

006* 

TEST =1.0 

0 065 

GO  TO  1 3 

0066 

15 

M>rK=KPCK* 1 

0067 

J = f HO^S*'<PCK 

OOSb 

C(TtJ)=-l  .0 

006* 

KEPT ( I ) = J 

0070  * 

J*1 

00  71 

VALX (K , J) =1 , 

00  72 

NAR I =UaR1 ♦ 1 

0 07  3 

TEf.T  = L,0 

007* 

GO  TO  13 

0075 

18 

KPfK  = KPCK ♦ 1 

AAI 
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(< ! j I -v  A >4  IV  0 LfvLL  ?)  f I li l SH  HUE  = 770  TC  12/21/18 


o nol 

Sui  BOUT  If.'t-  FINISH! " tIS  1 ,RHS» V Al* ,NRRT ,kpck ,Y,NHOWS* KEPT, TEST)  " 

pop? 

PE  M.  NFC.SLr 

pool 

dimension  v(.ly(60*10) 

0 o n 4 

Op’E'lS  ION  / V £ L ( 1 0 ) 

oops 

DIMENSION  RHS (60 ) 

OOPS 

0 I ”E NS  I ON  HFPT<60) 

ooo7 

"l)I  MENS  TON  Y(60) *RHS1 (60) 

C 

R«S!  IS  THE  RESERVED  VECTOR  OF  RHS  VALUES  FROM  THE  BEGINNING. 

C 

THE  EMU ING  RHS  VALU1S  ARE  SUBTRACTED  FROM  THE  BEGINNING  ONES 

C 

AMD  THE  RFSULT  IS  PLACED  INIO  THE  APPROPRIATE  SLACK  COLUMN. 

C 

THE  RfMATNOFR  OF  THE  VALUES  ARE  PRINTED  ON  PAGF  TWO  OF  THE  RE- 

c 

SULTS. 

c 

c 

c 

SLACK  ANALYSIS 

0 0 0 9 

M’TTF <6, 21) 

door 

21 

F(H.  -AT  ( iRl  , 120X,  'PAGE  06 » // * S" X ♦ • SL A CK  ANALYSIS') 

ooio 

1 

FORMAT (////) 

0011 

WPI TE (6, 1 ) 

oni? 

WRITE (6,4) 

0013 

8 

FORMAT ( 1 OX, 'ROW • ,6X, 'AVAIL  ABLE' , 12X* 'POS-SLK ' , 1 2X ' nE  G-SLK ' ) 

001“ 

WRITE  (6,1 ) 

0019 

DO  l‘»  I = 1,UR0«S 

00  16 

NF^SLKsO.O 

0017 

P(19SLK  = 0.0 

001b 

DO  11  JsltMROWS 

P019 

Msy ( J) 

cm) 

IF(I-H)  9,10,9 

oo?i 

9 

I r ( m-ktpt  (ill  ii,i?,n 

0022 

1 1 

C(H  T IN' IE 

0023 

GO  TO  1 3 

00?4 

10 

NEESI.KsRhS  ( j) 

OOPS 

GO  TO  13 

0026 

12 

POSSLKsRMS ( J) 

no?7 

13 

WRT  TE (6, 1 4) I , RHS 1 ( I ) ,POSSLK ,NEGSLK 

0028 

14 

FORMAT ( IPX, 1 3, 3F2U.5) 

0029 

19 

CONTINUE 

0030 

c 

43 

format (10X, I3,3X,F15.5) 

c 

c 

VAR  I HLF  AMOUNTS 

00  31 

WRITE  (6,4*,) 

003? 

44 

format ( ml , 120X, 'PAGE  07'//,50X, »VARI AHLF  ANALYSIS') 

0033 

wWITT  (6,  .9) 

00  14 

49 

FORMAT (////, 7X, 'VARIABLE  AMOONT • ,//) 

0039 

DO  41  I=l*MPOW> 

0 0 36 

NCf'CK  = Y ( 1 ) -kPCk-nRO*S 

0037 

IF  ( iClir,K)  41 ,41 ,4? 

0039 

4? 

<*  R T I E (6,4  J)MCHCK«RHS(  I 1 

0039' 

41 

C0"(1MIJF 

0040 

•.RJ  TE  (6,72) 

0041 

72 

FORMAT ( 1H1 1 

004? 

■ - 

»°1 IF (6, SO) 

004  3 " So  FGPMaI 7 7f ' SSX,  * ANALYSIS  OF  THt  OBJECT  IVE  • *?3X»  'PAGE  8»~»////,S0X*  *P 


AHIOHITY' * 10X,  'UNDER- ACM  I EVE ME NT  • ,/) 
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AAI 


fohthan 

IV  G LEVEL 

?1  FINISH 

DATE  = 77070 

0044 

O' ) 5?  K*1*NPWT 

0045 

ZV4L  (K ) =0. 0 

004b 

00  51  I=1*NP0WS 

0047 

51 

7 V ft  L * K ) = 7Vtl_  (K)  ♦VALY(I*K)»PHS(I) 

0 0 4 d 

L 1 5P  = S>»M  T ♦ 1 

004  H 

KK  = L I S'*-*' 

0050 

IF  (TEST  • ff 0 . o • 0 l GO  TO  5? 

0051 

KK*5PHf-K 

005? 

IF (KK.OT.O)  CO  TO  5 2 

0053 

KKrGPHT-K 

005» 

IF(KK.GT.O)  GO  TO  3? 

0055 

»P|Tfc (5,701  7VAL  ( K ) 

OO-ib 

in 

F 0»  HaT{/*45X«  * ARTIFICIAL •«5XtF20. 5) 

0 OS  7 

GO  TO  77 

OOS'J 

52 

WHITE (6*53)  KK.ZVALIK) 

005  i 

53 

FOPHAT (1H0.5?X, I?t5X,F?0.5) 

0050 

77 

CONTINUE 

0051 

STOP 

005? 

tun 

142 


AAI 


start 


DATE 


77070 


ft  w|-«An  It/  ti  Lt  Vi  L 21 


O'l  76 

JrKPCK*NBOwS 

0077 

C ( I t J) = -l .0 

0078 

KEPT ( I ) = J 

0079 

13  CONTINUE 

C 

C 

C READ  THF  OBJECTIVE  FUNCTION 




onno 

be  AD  (6,21 ) AKAMF 

OOfil 

19 

I = o 

0002 

IF  ( ANA-'E.NE.OHJ!  GU  TO  920 

009  \ 

IF  (A'iA-E  .EO.OMJ)  GO  TO  20 

on-)<> 

£0 

RE  All  (6,21 ) ANAF.F * I »«» TFMP 

003S 

IF  (AUA  E.EO.OATA)  C-0  TO  30 

0086 

IF(.a.lF.O)  GO  TO  1022 

on«  7 

K=l I5P-M 

0 088 

21 

FOiMftT ( A6*?IS»F16.0) 

O0n-> 

IF ( J.Lf .0)  GO  TO  1022 

0090 

IF  (K.Gr.HPRT)  GO  TO  1026 

0091 

IF ( ANA"E.EO.MFG)  GO  TO  26 

(P  0 92 

IF  ( ANA-'E.EO.POS)  GO  TO  25 

0093 

GO  TO  27 

0 0 96 

26 

J=T 

0096 

VALX  (K, J) = Tf MP 

0096 

GO  TO  20 

0 09  7 

26 

J=KtPT ( I ) 

0 09!) 

IF  (KEPT (1 ) .EQ.O)  GO  TO  1026 

0099 

VALX  (K,  J)  =Tt*4P 

n 1 o o 

GO  TO  20 

0)01 

27 

IF  (TEMP) 926.20,926 

C 

C 

c 

c 

BEAD  THE  OAT  A MATRIX  IN 

0 102 

' 30 

PF.AD  (6,21  ) ANAMF.I,  J.TEMP 

0103 

IF  (AMA-'E.EQ.RGHT  ) GO  TO  60 

010* 

lE(I.LF.O)  GO  TO  1 V 90 

0106 

IF  ( J.EP.O)  GO  TO  1090 

01  06 

J = KPC.K*NPUwS*J 

0107 

c ( T , J ) =TF  MR 

0108 

c 

GO  TO  90 

c 

c 

c 

RE  AO  THF  RIGHT  HAND  SIDE 

0109 

60 

RF.AD  (5.66  ) (PHS  ( I ) * I = 1 »NPO*S) 

0110 

c 

66 

F 0 P M A T ( FJF  10,0) 

c 

c 

wpite  the  above  results 

# c 

0111 

WRT TF (6*6015) 

0112 

5015 

FORMAT (GSX, «THE  RIGHT  hand  S I Ut - 1 NPU I • , 33X , • PAGE  01*) 

0113 

DO  61  t=)tNROWS 

0116 

IF  (HHS  ( I ) ) 9<,1 ,62,63 

0116 

62 

RMS ( I) =. 00001 

AAI 
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1 

r ( m t R an  ] v 

G Lf  vKL  21  START  DATE.  = 77070  12/21/lrt 

0 11  b 

43  WHS]  ( I ) =ons ( I ) 

i 

Oil? 

WRJ  TF  (»■  • 1 1 1 1 ) I ♦ WHS  ( I ) 

i 

Oil-' 

llll  For  MAI  { 1 ox  » I3*2X,F14.4  ) 

m 

0119 

*1  Dr  T INllE 

P1?0 

wRj  TF.  <4  • o?0  ) 

i 

m?i 

62 0 F 01-  M A T ( 1 H 1 ) 

1 

0 1 22 

WHITE ( 4 t 40 1 6 ) 

V 

o 1 ?3 

4016  EOomaT (44X, *THF  SUBSTITUTION  H A TFS- I NPUT • * 1 OX , • P AGE  02*1 

0124 

00  111?  1 = 1*  NWOWS 

1 

0124 

WWTTF  (4,?419)_  I 

1 

01?b 

2419  E Of  i A T ( 1 7 * ’ n 0 «'  < * 1 4 ) 

0 1?? 

1 J 12  UWITF  (6, 1 1 1 3)  (C  (I  *U)  * v<=l  * NSJZE) 

01  ?u 

1 1 1 3 E A T ( 1 OE  1?. 3) 

1 

0 1 ? 3 

WRITE (4*620) 

1 

0 130 

w R I T F (4*4017) 

0131 

4017  FORMAT ( s s a , * THE  OHJECTIVE  EUNC  T ION-INPUT  * * 19X* • P AGF  0 3 • ) 

0132 

DU  1114  K = 1 ,'JPPT 

0133 

h = l 1 4b-K 

0 1 3<* 

WPJ TF  (4*2  140)  M 

01  3b 

2140  FO-O'AIC  PwiOPITY*  * 14) 

01  3b 

1 1 14  *PI IE  (4. 1 1 1 3)  ( VALX (K, J) , J=1 , US1ZE) 

— 

0137 

WRITE  (6,620) 

01  3'i 

wP  I TE  (4*4013) 

0139 

40 1 0 EO'  DAT (S'Y, •SUMMARY  OF  INPUT  INFORMATION  • • 1 VX . * P AGF • * * 04') 

0 140 

NVaRsNS  I ZE 

0 1 4 1 

wRITE  ( 4 * ?U  1 7 1 f<lRO«/S.NVAR,EPRT*r  ART 

0]42 

2017  FORMAT  ( 10X,  'NUMBER  OF  ROWS • • 14  • / « 1 OX  * ' NU  <1  <ER  OF  VARIABLES 

* (5./. 1 OX* 'NUMBER  OF  PRIORI  TIES. .,'* 14. /« 1 OX *• AOOfO  PRIOR 

2ITIES • . 14) 

0 1 4 3 

IF (MART. 01. 0)  NPRT=NPRT* 1 

0 1 '4  4 

PE  TURN 

0 144 

910  *<P  I TF  (i  ,414) 

'I  1 <4  0 

91A0FONWAT ( " ROGPAM  CONTAINS  AN  ERROR  EITHER  IN  THE  NUMBER  OE  KOwS  PUN 

ICHfO  OR  IN  THE  SION  CARO. THE  VALUE  IS  SOMETHING  OTHER  THAN  "E"*"G" 

2 » OR "L " • ) 

0 ) '.7 

GO  TO  6 >o 

0 1 . H 

1090  w'MTEif  , 1091) 

0 1 4 ? 

1091  FO'-'ATC  IMPROPER  DATA  COLUMN  OR  ROw  DEFINITION') 

0 1 S') 

GO  TO  RRR 

ol  M 

920  wRITF tG,9?l ) 

0142 

921  OF O-H'A T ( • AN  OBJECTIVE  CARO  WITH  THE  V ALUF • * F 1 4. 3 • ' I 

IS  FOUND  I'UT  INSTRUCT  IONS  AS  TO  WHICH  DEVIATION  HAS  BEEN  NEGLECTED. 

2EXAHHE  YOUR  DATA  ') 

0143 

CO  To  9 

014** 

1020  wrttE( r*,l021) 

0144 

1021  FORMAT ( ' MUO'FR  0)  ROWS*  VARIARLFS*  OR  PRIORITIES  CANNOT  BE  E«UA 

1L  TO  Zr»0  UNDER  ANY  CIRCUMSTANCES' ) 

0 l so 

GO  10  099 

0 147 

1022  wpite(4*1023) 

oiso 

1023  FORMAT ('  COLUMN  VALUE  OR  PRIORITY  VALUE  IS  EQUAL  TO  OR  LESS  THAN 

6 

1 ZEpU  •) 

0 149 

GO  TO  999 

0140 

911  wRITE (4*91?) 

olbl 

9 1 2 0 F 9 R M A T ( ' The  NUMBER  OF  VARIABLES  NEEDED  TO  COMPUTE  THIS  PROGRAM 

IIS  TOO  GREAT  UNDER  PRESENT  DIMLNSIONS.  SET  YOUR  PROGRAMMER  FOR  AL 

2 TEWING  THIS  RESTRICTION  TO  MEfc 1 YOUR  NEEDS') 

1A4  AAI 

*UM  M 

...  4 

F n«> T tV An  IV  C.  LEVEL 


START 


DATE 


77070 


12/?1/16 


21 


0 162  on  to  999 

0163  _ 1 p2o  -R] TE  (6*  1 027) 

0164  IOC?  FORMAT ( • ATTEMPT  IS  MADE  TO  MINIMIZE  NON  EXISTANT  POSITIVE  DE  V I A 

1 T ION • ) 

0 1 6b  00  TO  099 

0 1 66 1024  WRITE  16*10  25) 

0167  10  2 6 FORMAT  (•  OBJECTIVE  FUNCTION  PRIORITY  EXCEEDS  STATED  NUMBER  OF  PRI 

1 OR  I T T F S • ) 

0166  GO  TO  999 

0169  901  WRITE (6*902) 

0170  90?  FORMAT ( • PRORLEM  CARO  MISSING  OR  MISPUNCHED') 

0 171 *’0  TO  999 

017?  926  '-RTTF(6,92  7) 

01  73  927  F ()!■  >‘  a r ( * A CARD  IN  THE  OBJECTIVE  SECTION  DEFINED  SOME  VALUE  FOR  T 

ImL  ORJFCTIVF  FUNCTION  HUT  K A I L t L)  TO  DEFINE  WHETHER  THIS  WAS  TO  AP 
2F’L  v TO  THt  POSITIVt  OR  NEGATIVt  DEVIATION') 

0174  94)  »RTIF(fi«9*2) 

0 1 7 S 94?  F • > • A T ( » NEGATIVE  VALUES  ARE  NOT  ALLOWED  ON  THE  RIGHT  HAND  SIDE. 

1 Ci  f-RECT  PROBLEM  HY  MULTIPLYING  ENTIRE  CONSTRAINT  THROUGH  BY  MINU 
?9  ONE.') 

0176  GO  TO  999 

0177  999  R T OP 

0176  ENn 


AAI 

■ Ur 


145 


